* [katana v1.8.0](https://github.com/projectdiscovery/katana) – Next-generation crawling and spidering framework designed for automation pipelines.

* [catbus v0.1.0](https://github.com/cv-cat/catbus) – Command-line tool that gathers item search results from multiple social platforms and outputs normalized JSON for users and AI agents.

* [FindJobs-Agent v1.1.0](https://github.com/he-yufeng/FindJobs-Agent) – Full-stack job search assistant that crawls postings, uses LLMs to analyze skills, matches them to parsed resumes, and runs AI mock interviews.

* [Scrapfly Anti-bot Detector v2.8.4](https://github.com/scrapfly/Antibot-Detector) – Manifest V3 Chrome extension detecting CAPTCHAs, anti-bot systems, and browser fingerprinting in real time with confidence scores and capture tools.

* [CrawlerDetect v1.2.18](https://github.com/loadkpi/crawler_detect) – Ruby gem for detecting bots, crawlers, and spiders based on user agent and HTTP headers.

* [The CROWler v2.2.7](https://github.com/pzaino/thecrowler) – Self-hosted, event-driven platform for browser-based web crawling, scraping, detection, and automation with rulesets, plugins, agents, and search API.

* [top-user-agents v2.1.139](https://github.com/microlinkhq/top-user-agents) – Always up-to-date list of the top 100 HTTP user-agent strings used on the Internet.