Hola betas, tengo una pequeña duda, he creado un archivo robots.txt para mi foro smf que monte ayer, pero me indexa cosas que no quiero que aparezcan aparte de Disallow hay otra forma de evitar que Google incluya esas áreas del foro en su indice? las areas que no quiero que me indexens son: la versión movil, login, search, login etc.
les dejo mi robots.txt
Saludos
les dejo mi robots.txt
Insertar CODE, HTML o PHP:
User-Agent: *
Disallow: /attachments/
Disallow: /Packages/
Disallow: /avatars/
Disallow: /imagenes/
Disallow: /?wap2/
Disallow: /activate/
Disallow: /admin/
Disallow: /calendar/
Disallow: /recent/
Disallow: /collapse/
Disallow: /deletemsg/
Disallow: /editpoll/
Disallow: /help/
Disallow: /helpadmin/
Disallow: /lock/
Disallow: /login/
Disallow: /logout/
Disallow: /markasread/
Disallow: /mergetopics/
Disallow: /mlist/
Disallow: /modifykarma/
Disallow: /movetopic/
Disallow: /notify/
Disallow: /notifyboard/
Disallow: /pm/
Disallow: /post/
Disallow: /profile/
Disallow: /register/
Disallow: /removetopic2/
Disallow: /reporttm/
Disallow: /search/
Disallow: /sendtopic/
Disallow: /splittopics/
Disallow: /stats/
Disallow: /sticky/
Disallow: /trackip/
Disallow: /unread/
Disallow: /unreadreplies/
Disallow: /who/
Disallow: /?PHPSESSID
Disallow: /?wap2
Disallow: /Themes/
Disallow: /index.php?action=activate
Disallow: /index.php?action=admin
Disallow: /index.php?action=arcade
Disallow: /index.php?action=calendar
Disallow: /index.php?action=collapse
Disallow: /index.php?action=deletemsg
Disallow: /index.php?action=editpoll
Disallow: /index.php?action=help
Disallow: /index.php?action=helpadmin
Disallow: /index.php?action=lock
Disallow: /index.php?action=login
Disallow: /index.php?action=logout
Disallow: /index.php?action=markasread
Disallow: /index.php?action=mergetopics
Disallow: /index.php?action=mlist
Disallow: /index.php?action=modifykarma
Disallow: /index.php?action=movetopic
Disallow: /index.php?action=notify
Disallow: /index.php?action=notifyboard
Disallow: /index.php?action=pm
Disallow: /index.php?action=post
Disallow: /index.php?action=profile
Disallow: /index.php?action=register
Disallow: /index.php?action=removetopic2
Disallow: /index.php?action=reporttm
Disallow: /index.php?action=search
Disallow: /index.php?action=sendtopic
Disallow: /index.php?action=splittopics
Disallow: /index.php?action=stats
Disallow: /index.php?action=sticky
Disallow: /index.php?action=trackip
Disallow: /index.php?action=unread
Disallow: /index.php?action=unreadreplies
Disallow: /index.php?action=who
Disallow: /index.php?wap2
Disallow: /*.msg
Disallow: /msg/Saludos
