GitHub Release Tracker
All JS React Ruby Go Postgres Frontend Node

crawler

Past 30d, sorted by best first, all versions
13 results Markdown version
08/05 8
projectdiscovery/katana v1.7.0
Next-generation crawling and spidering framework designed for automation pipelines.
Go 17308☆ 2048d old #golang #cli #go #crawler #web-spider
08/25 7
pzaino/The CROWler v2.1.0
Self-hosted, event-driven platform for browser-based web crawling, scraping, detection, and automation with rulesets, plugins, agents, and search API.
Go 62☆ 1017d old #golang #go #crawler #crawling #indexing
08/23 6
Autumn-27/Scope Sentry v1.9.4
Distributed asset-mapping and scanning platform for subdomain enumeration, port and vulnerability scanning, information leakage detection, and monitoring.
07/31 6
pzaino/The CROWler v2.0.1
Self-hosted, event-driven platform for browser-based web crawling, scraping, detection, and automation with rulesets, plugins, agents, and search API.
Go 62☆ 1017d old #golang #go #crawler #crawling #indexing
08/27 5
pzaino/The CROWler v2.1.1
Self-hosted, event-driven platform for browser-based web crawling, scraping, detection, and automation with rulesets, plugins, agents, and search API.
Go 62☆ 1017d old #golang #go #crawler #crawling #indexing
08/24 5
microlinkhq/top-user-agents v2.1.132
Always up-to-date list of the top 100 HTTP user-agent strings used on the Internet.
JavaScript 363☆ 2379d old #javascript #browser #desktop #user-agent #crawler
08/17 5
microlinkhq/top-user-agents v2.1.131
Always up-to-date list of the top 100 HTTP user-agent strings used on the Internet.
JavaScript 363☆ 2379d old #javascript #browser #desktop #user-agent #crawler
08/10 5
microlinkhq/top-user-agents v2.1.130
Always up-to-date list of the top 100 HTTP user-agent strings used on the Internet.
JavaScript 363☆ 2379d old #javascript #browser #desktop #user-agent #crawler
08/07 5
pzaino/The CROWler v2.0.3
Self-hosted, event-driven platform for browser-based web crawling, scraping, detection, and automation with rulesets, plugins, agents, and search API.
Go 62☆ 1017d old #golang #go #crawler #crawling #indexing
08/06 5
pzaino/The CROWler v2.0.2
Self-hosted, event-driven platform for browser-based web crawling, scraping, detection, and automation with rulesets, plugins, agents, and search API.
Go 62☆ 1017d old #golang #go #crawler #crawling #indexing
08/05 5
microlinkhq/top-user-agents v2.1.129
Always up-to-date list of the top 100 HTTP user-agent strings used on the Internet.
JavaScript 363☆ 2379d old #javascript #browser #desktop #user-agent #crawler
08/03 5
microlinkhq/top-user-agents v2.1.127
Always up-to-date list of the top 100 HTTP user-agent strings used on the Internet.
JavaScript 363☆ 2379d old #javascript #browser #desktop #user-agent #crawler
08/03 5
microlinkhq/top-user-agents v2.1.126
Always up-to-date list of the top 100 HTTP user-agent strings used on the Internet.
JavaScript 363☆ 2379d old #javascript #browser #desktop #user-agent #crawler