# Robots.txt file from http://www.gaypuertovallartahotel.com # # All robots will spider the domain User-agent: * Disallow: /video/ User-agent: msnbot Crawl-delay: 120