kreuzcrawl, an open source Rust crawling engine with 11 language bindings
·
0 reactions
·
0 comments
·
2 views
kreuzcrawl is a high-performance web crawling engine. It was designed to reliably extract structured data, operating natively across multiple languages without enforcing a specific runtime. See here: The MCP server is integrated from the start, enabling web-crawling AI agents as a primary use case. Streaming crawl events allow real-time progress tracking. Batch operations handle hundreds of URLs concurrently and tolerate partial failures. Browser rendering supports JavaScript-heavy SPAs and incl
Original article
Reddit
Anonymous · no account needed
