crawler
| Date | Project Name | 🎉 | ? | Tags |
|---|---|---|---|---|
| 07/31 |
Browsertrix Crawler v1.7.0
* [Browsertrix Crawler v1.7.0](https://github.com/webrecorder/browsertrix-crawler) – Standalone browser-based high-fidelity crawling system running customizable crawls in a single Docker container.
Standalone browser-based high-fidelity crawling system running customizable crawls in a single Docker container.
|
7
|
TypeScript 839 ⭐1737 days old |
typescript crawler crawling wacz warc web-archiving |
| 07/24 |
katana v1.2.1
* [katana v1.2.1](https://github.com/projectdiscovery/katana) – Next-generation crawling and spidering framework designed for automation pipelines.
Next-generation crawling and spidering framework designed for automation pipelines.
|
7
|
Go 13983 ⭐1671 days old |
cli go crawler web-spider gocrawler spider-framework |
| 07/23 |
katana v1.2.0
* [katana v1.2.0](https://github.com/projectdiscovery/katana) – Next-generation crawling and spidering framework designed for automation pipelines.
Next-generation crawling and spidering framework designed for automation pipelines.
|
8
|
Go 13983 ⭐1671 days old |
cli go crawler web-spider gocrawler spider-framework |