User-Agent: *
Allow: /
Disallow: /404.html

User-Agent: Megalodon
Disallow: /

User-agent: ia_archiver
Disallow: /