User-agent:* Disallow: /admin/ Disallow: /api/ Disallow: /awstats/ Disallow: /cgi-bin/ Disallow: /cp/ Disallow: /*? Disallow: /css/ Disallow: /js/ Disallow: /new-web/ Disallow: /webalizer/