Marketing glossary
What is Crawl Budget?
Crawl Budget: How many pages a search engine is willing and able to crawl on your site in a given period.
Crawl budget mainly matters for large sites with thousands of URLs. You protect it by avoiding endless URL variations, keeping sitemaps clean, fixing broken links and redirect chains, and making important pages easy to reach through internal links.
Related terms
- IndexingThe process of a search engine storing a page in its database so it can appear in search results.
- Internal LinkingLinks from one page on your website to another, which help visitors navigate and help search engines understand structure and importance.
- Technical SEOOptimizing how search engines crawl, render, and index a website, covering speed, mobile usability, site structure, redirects, and structured data.