HubSpot CMS for Developers II Certification 

Fill in the blank: The primary function of a robots.txt file is_______________.

Editorial Staff
  • to prevent pages from appearing in search results
  • to tell search engines about which of your site’s pages you’d like them to crawl
  • to prevent your site from being overloaded with requests by crawlers
  • to control exactly which pages appear in search results

The correct answer is:

  • to prevent your site from being overloaded with requests by crawlers

🎓 Get all the latest and 100% correct HubSpot CMS for Developers II Certification Exam Answers