# robots.txt for tdrwww.exp-math.uni-essen.de User-agent: CiteSeerBot Allow: * User-agent: * Disallow: /temp Disallow: /temp2