User-agent: * #Disallow: #no permitir estos directorios Disallow: /admin/ Disallow: /cache/ Disallow: /cgi-bin/ Disallow: /docs/ #Disallow: /download/ Disallow: /editors/ Disallow: /email/ #Disallow: /images/ Disallow: /includes/ #Disallow: /media/ Disallow: /phpMyAdmin/ #1 peticion cada 60 segundos Crawl-delay: 60 #v2.0, horario de visita de 02:00 a 07:45 Visit-time: 0200-0745 #v2.0, 1 documento cada 1 minutos Request-rate: 1/60