#Prevent robots from accessing the files under news user-agent * Crawl-delay: 10 Disallow: /news/