User-agent: * Disallow: /cgi-bin/ Disallow: /logs/ Disallow: *.php User-agent: Slurp Disallow: / User-agent: Grub Disallow: / User-agent: WISENutbot Disallow: / User-agent: Inktomi Disallow: / User-agent: turnitinbot Disallow: / User-agent: W3CRobot/5.4.0 libwww/5.4.0 Disallow: / User-agent: msnbot/0.3 Disallow: / User-agent: Gigabot/2.0 Disallow: /