User-agent: * Disallow: /folder/ Disallow: /gallery/ Disallow: /stream/ Disallow: /preview/ Disallow: /filebox/ Disallow: /trafficshare/ Disallow: /file/ Disallow: /legal/dmca.php Disallow: /f/ Disallow: /dlf/ Disallow: /dl/ Disallow: /dlp/ User-agent: Mediapartners-Google* Disallow: User-agent: ia_archiver Disallow: /