robots.txt file


modified robots.txt file to stop bots and spiders from indexing undated pages on the site