User-agent: * # directed to all robots User-agent: Mediapartners-Google* Disallow: /cgi-bin/sources Disallow: /access_stats Disallow: User-agent: searchpreview* Disallow: /cafeteria/lunch_menus/ Disallow: /videos Disallow: / natcrawlbloc01.net.m1.fti.net Disallow: / natcrawlbloc02.net.m1.fti.net Disallow: / natcrawlbloc03.net.m1.fti.net Disallow: / VoilaBot BETA 1.2