User-agent: Googlebot Disallow: /*? Disallow: /pub/* User-agent: ia_archiver Disallow: /