all Ok check everyday
User-agent: *
allow: all
Crawl-delay: 5
Disallow: /cgi-bin/