After SEO blogger Malcolm Coles revelation that The Daily Mail had hidden an advertisement for a SEO manager within a robots.txt file on the site (a simple text file that stops search engines recognising the file and its commands) from crawling the site, selected pages in the site, or selected file types in the site) …