User-agent: * Allow: /images/ Disallow: /css/ # stupid bots! a 404 is a 404!... I have to disallow non # existent directories :(