# Robots.txt file created by John Simpson(Rare IT) # For domain: http://www.rareit.com # All robots will spider the domain User-agent: * Disallow: /Backup/ Disallow: /Backup3/ Disallow: /bin/ Disallow: /coursediary/ Disallow: /downloads/ Disallow: /email_footer/ Disallow: /emailer/ Disallow: /forms/ Disallow: /GillsStuff/ Disallow: /jetcraft/ Disallow: /nwin/ Disallow: /tna/ Disallow: /vrbc/ Disallow: /specialistlamps/ Disallow: /client-access/ Sitemap: http://www.rareit.com/sitemap.xml