User-agent: Wget Disallow: / User-agent: * Disallow: /admin/ Disallow: /css/ Disallow: /error/ Disallow: /images/ Disallow: /includes/ Disallow: /js/