# Robots.txt file from 9fun.org # All robots will spider the domain User-agent: * Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /trackback Disallow: /feed Disallow: /?r=* Sitemap: http://www.9fun.org/sitemap.xml Sitemap: http://www.9fun.org/sitemap.xml.gz