# Robots.txt file from http://www.ju690.com # All robots will spider the domain User-agent:* Disallow:/itstatic/ Disallow:/meme/entry/ Disallow: /*photos/ User-agent: Slurp Disallow:/ User-agent: YodaoBot Disallow:/ User-agent: Sosospider Disallow:/ User-agent: twiceler. Disallow:/ User-agent: Sogou Disallow:/ User-agent: sogou spider Disallow:/ User-agent: psbot Disallow:/ User-agent: Yeti Disallow:/ User-agent: msnbot-media Disallow:/ Sitemap:http://news.ju690.com/sitemap.xml # End robots.txt file