User-agent: * Disallow: /admin Disallow: /comment/ Disallow: /comment/reply Disallow: /comment/reply/ Disallow: /node/add/ Disallow: /node/all/* Disallow: /search/* Disallow: /user/login/ Disallow: /profile Disallow: /contact Disallow: /vote_up_down/ Disallow: /my_quotes Disallow: /bookmarks Disallow: /flag/ Disallow: /messages/ Disallow: /taxonomy/ Disallow: /*/feed$ Disallow: /*/rss$ Disallow: /*/track$ Disallow: /tracker Disallow: /*&openid_identifier= Disallow: *?destination Disallow: *?qt Disallow: /user/* Disallow: /hybridauth Disallow: /signin Disallow: /report Disallow: /image_captcha Disallow: /votes Disallow: /users/* Disallow: /ajax Disallow: *page=0 # Directories Disallow: /includes/ Disallow: /misc/ Disallow: /modules/ Disallow: /profiles/ Disallow: /scripts/ Disallow: /sites/ Disallow: /themes/ # Files Disallow: /cron.php Disallow: /update.php Disallow: /xmlrpc.php Disallow: /buy.php Allow: /user/register Allow: /user/password Allow: /user/*/collections Allow: /user/131777/translations ### Yandex ### User-Agent: Yandex Clean-param: destination&openid_identifier&qt&sort_bef_combine&sort_by&name&rate&osm&p__&&_&hage&oprd&pa__&pag&pag__&post&utf&usg&refresh"&__ Disallow: /*/amp Disallow: /admin Disallow: /comment/ Disallow: /comment/reply Disallow: /comment/reply/ Disallow: /node/add/ Disallow: /node/all/* Disallow: /search/* Disallow: /user/register/ Disallow: /user/password/ Disallow: /user/login/ Disallow: /profile Disallow: /contact Disallow: /vote_up_down/ Disallow: /my_quotes Disallow: /bookmarks Disallow: /flag/ Disallow: /messages/ Disallow: /taxonomy/ Disallow: /*/feed$ Disallow: /*/rss$ Disallow: /*/track$ Disallow: /tracker Disallow: /user/* Disallow: /hybridauth Disallow: /signin Disallow: /report Disallow: /image_captcha Disallow: /votes Disallow: /users/* Disallow: /ajax Disallow: *page=0 Disallow: /includes/ Disallow: /misc/ Disallow: /modules/ Disallow: /profiles/ Disallow: /scripts/ Disallow: /sites/ Disallow: /themes/ Disallow: /cron.php Disallow: /update.php Disallow: /xmlrpc.php Disallow: /buy.php Allow: /user/register Allow: /user/password Allow: /user/*/collections User-agent: Slurp Disallow: / User-agent: yahoo-newscrawler Disallow: / User-agent: MJ12bot Disallow: / User-agent: Butterfly Disallow: / User-agent: Spinn3r Disallow: / User-agent: Riddler Disallow: /