# Google Image Crawler Setup User-agent: Googlebot-Image # Crawlers Setup User-agent: * # Allow paging Allow: /*?p= # Directories Disallow: /404/ Disallow: /app/ Disallow: /cgi-bin/ Disallow: /downloader/ Disallow: /errors/ Disallow: /includes/ #Disallow: /js/ #Disallow: /lib/ Disallow: /magento/ #Disallow: /media/ Disallow: /pkginfo/ Disallow: /mpblog/ Disallow: /report/ Disallow: /scripts/ Disallow: /shell/ Disallow: /skin/ Disallow: /stats/ Disallow: /var/ # Paths Disallow: */index.php/ # Files Disallow: /cron.php Disallow: /cron.sh Disallow: /error_log Disallow: /install.php Disallow: /LICENSE.html Disallow: /LICENSE.txt Disallow: /LICENSE_AFL.txt Disallow: /STATUS.txt # Directories Disallow: /*?dir* Disallow: /*?limit* Disallow: /*?mode* Disallow: /*?___from_store=* Disallow: /*?___store=* Disallow: /*?cat=* Disallow: /*?q=* Disallow: /*?price=* Disallow: /*?availability=* Disallow: /*?brand=* # Paths (no clean URLs) Disallow: /*.js$ Disallow: /*.css$ Disallow: /*.php$ Disallow: /*?SID= Disallow: /*?p=*& Sitemap: http://www.amazonia.com/sitemap.xml