# Robots.txt file from http://pi.informatik.uni-siegen.de # User-agent: Googlebot/2.X (+http://www.googlebot.com/bot.html) User-agent: Lycos/x.x User-agent: FastCrawler 3.0.X (crawler@1klik.dk) - http://www.1klik.dk User-agent: CoolBot User-agent: Die Blinde Kuh User-agent: Deweb/1.01 Disallow: /api/ Disallow: /aboutair/ Disallow: /eifler/ Disallow: /flick/ Disallow: /lehmann/ Disallow: /monecke/ Disallow: /mstollen/ Disallow: /ntt/ Disallow: /ohst/ Disallow: /piao/ Disallow: /platz/ Disallow: /proj/ Disallow: /schild/ Disallow: /schuh/ Disallow: /sfb/ Disallow: /welle/ Disallow: /mags/ # #EOF