# Robot Exclusion File -- robots.txt # Author: Darren Rogers # Changed by PJK frequently # Last change 2/23/2017 User-agent: * Sitemap: https://mblc.state.ma.us/directories/special-collections/sc_sitemap.xml.gz Disallow: /admin/ Disallow: /jobs/submit_jobs/job_form.php Disallow: /cjdb/ Disallow: /crdb/ Disallow: /mainttool/ Disallow: /cufts/ Disallow: /dashboard/ Disallow: /godot/ Disallow: /godotconfig/ Disallow: /_includes/ Disallow: /_includes-cms/ Disallow: /directories/libraries/barcode.php Disallow: /ssofwk/ Disallow: /sympa/ Disallow: /rss/ Disallow: /surveys/