# Robots.txt file from https://www.bcn.cl # All robots will spider the domain User-agent: * crawl-delay: 60 Disallow: *.php* Disallow: */mas_videos?id=* Disallow: /*_zpt$ Disallow: /*view$ Disallow: /presupuesto/ Disallow: /rss/ Disallow: /leychile/navegar?idNorma=1007783* Disallow: /siit/simuladorelectoral Disallow: /transparencia/ #Candidato a eliminar Disallow: */at_download/* Disallow: */proxy/* Disallow: */pdf/* Disallow: *searchterm*