# robot exclusion for www.comune.imola.bo.it # Define access-restrictions for robots/spiders # http://www.robotstxt.org/wc/norobots.html Sitemap: https://www.comune.imola.bot.it/sitemap-index.xml User-agent: gigabot Crawl-delay: 120 Disallow: /folder_contents$ Disallow: /folder_factories$ Disallow: /search Disallow: /sendto_form$ Disallow: /api