# robots.txt — salemymachine.com # Location: public_html/robots.txt User-agent: * Allow: / # Infrastructure and admin Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /Master/ # Account pages — nothing to index, and they vary per session Disallow: /User/login Disallow: /User/logout Disallow: /User/myprofile Disallow: /User/myupload Disallow: /User/forgotPassword Disallow: /User/setPassword # Filter permutations. These render the same inventory in a different order or # subset, so crawling them spends budget without adding an indexable page. # ?page= is deliberately NOT blocked — landing-page pagination is how deeper # listings get discovered. Disallow: /*?sort= Disallow: /*?availability= Disallow: /*?price_min= Disallow: /*?price_max= Sitemap: https://salemymachine.com/sitemap.xml Sitemap: https://salemymachine.com/sitemap-landing.xml