DarkWeb-Scanner orchestrates multi-threaded scraping through the Tor network using a high-performance Rust engine. It pairs a compiled Rust API backend with a Node.js frontend dashboard, all deployable via Docker Compose with an integrated Tor proxy.
Multi-threaded Rust engine for concurrent dark web scraping with configurable concurrency levels
Tor network integration via SOCKS5 proxy, bundled in the Docker stack
REST API with JWT authentication and admin token issuance
Web frontend built with Node.js for scan management and result viewing
CLI mode for headless, scriptable scans with JSON output
Docker Compose deployment for single-command setup of all services (API, frontend, Tor proxy)
SQLite/Postgres persistence with token management and revocation support
The Rust core handles all scraping logic, authentication, and database operations. The Node.js frontend provides a web interface for managing scans. Tor proxy routes all outbound traffic through the Tor network.
Docker and Docker Compose
Rust toolchain (for local builds only)
Node.js (for frontend local dev only)
Docker Compose (recommended)
Set required environment variables:
Build and start all services:
This starts three containers:
Run scans directly from the command line without the web frontend:
Environment Variables
API Reference -- endpoint definitions, authentication, request/response formats
Deployment Guide -- production setup, scaling, environment configuration
Implementation Details -- architecture decisions, module breakdown, data flow
This tool is designed for authorized security research and penetration testing only . Use of this software to access systems, networks, or data without explicit written authorization is illegal and unethical. The authors assume no liability for misuse. Always obtain proper authorization before conducting any security assessments.
This project is distributed under a restrictive license. See LICENSE_RESTRICTIVE.md for terms.
The full story
This article is one source in a clustered incident — the cluster page carries the summary, timeline and every other outlet covering it.
