Abstract: A focused crawler, also known as a topical crawler or selective crawler, is a web crawler designed to index specific types of content or websites based on predefined topics or criteria. Unlike general-purpose web crawlers that aim to index as much content as possible across the web, focused crawlers are more targeted and efficient.

Keywords: Focused crawler or topical crawler or selective crawler, Natural Language Processing (NLP), Crawl Policy, Indexing.

| DOI: 10.17148/IARJSET.2022.9346