User-agent: *
Disallow: /log/
Disallow: /*.pl$
Disallow: /*.dat$
Disallow: /*.log$