# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: Twitterbot Disallow: /flight_searches/ Disallow: /hotel_searches/ Disallow: /checkout/ Disallow: /basket/ Disallow: /ajax/ Disallow: /no_results_redirect/ Disallow: /searches/ Disallow: /server_status Disallow: /tripadvisor/ Disallow: /gatekeeper/ Disallow: /very-cheap-holidays Disallow: /helios_deals/ Disallow: /light_box/ User-Agent: * Disallow: /flight_searches/ Disallow: /hotel_searches/ Disallow: /deals/ Disallow: /checkout/ Disallow: /basket/ Disallow: /popups/ Disallow: /ajax/ Disallow: /no_results_redirect/ Disallow: /searches/ Disallow: /server_status Disallow: /tripadvisor/ Disallow: /email_review/ Disallow: /gatekeeper/ Disallow: /very-cheap-holidays Disallow: /hotels/*/trip_advisor_reviews$ Disallow: /deal/results/ Disallow: /helios_deals/ Disallow: /light_box/ Sitemap: https://www.onthebeach.co.uk/sitemap.xml