User-Agent: * User-agent: AdsBot-Google User-agent: Googlebot-Image User-Agent: SpringBot User-Agent: Springbot/1.0 Disallow: /feed/ Disallow: /sales/ Disallow: /contacts/ Disallow: /productalert Disallow: /productalert/ Disallow: /catalog/ Disallow: /catalog/product_compare Disallow: /catalog/product_compare/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /catalogsearch/result/?q Disallow: /catalogsearch/ Disallow: /catalog/product_compare/add Disallow: /catalog/product_compare/add/ Disallow: /wishlist Disallow: /*.idea$ Disallow: /*.php$ Disallow: /*.sql$ Disallow: /*.svn$ Disallow: /*.tgz$ Disallow: /*?dir* Disallow: /*?dir=asc Disallow: /*?dir=desc Disallow: /*?limit=all Disallow: /*?mode* Disallow: /ajaxsearch/ Disallow: /admin/ Disallow: /magic/ Disallow: /index.php/magic Disallow: /api.php Disallow: /app/ Disallow: /catalog/category/view/ Disallow: /catalog/product/view/ Disallow: /catalog/product_compare/ Disallow: /onestepcheckout Disallow: /catalogsearch/ Disallow: /checkout/ Disallow: /cron.php Disallow: /cron.sh Disallow: /customer Disallow: /customer/account/ Disallow: /customer/account/login/ Disallow: /CVS Disallow: /downloader/ Disallow: /error_log Disallow: /errors/ Disallow: /facebookconnect/customer/login/ Disallow: /facebookconnect/customer/logout/ Disallow: /get.php Disallow: /includes/ Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /newsletter/ Disallow: /onestepcheckout/ Disallow: /pkginfo/ Disallow: /poll/ Disallow: /README.txt Disallow: /RELEASE_NOTES.txt Disallow: /report/ Disallow: /sendfriend/ Disallow: /shell/ Disallow: /var/ Disallow: /review Disallow: /review/ Disallow: /shop-by-brand Disallow: /shop-by-brand/ Disallow: /blog/index/ Disallow: /blog/index Disallow: /blog/tag/ Disallow: /blog/tag Disallow: /blog/?p Disallow:/blog/cat/view/identifier/ Disallow: /lookup.php #Allow: /catalogsearch/advanced/ Allow: /index.php/ Allow: /media/ Allow: /blog Allow: /tag/ User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MauiBot Disallow: / User-agent: BingBot Crawl-delay: 10 User-agent: msnbot Crawl-delay: 10