Scrapeit
How Scrapeit's Workers Find Each Other Without a Central Broker
A REST endpoint as a rendezvous point, a Kademlia DHT for wide discovery, mDNS for the LAN, and a polling loop that keeps Postgres and Ethereum honest with each other: the plumbing behind Scrapeit's worker swarm.Why I Built Scrapeit: A Decentralized Scraping Marketplace
Scraping at any real scale costs money in infrastructure, proxies, and upkeep. Scrapeit is a marketplace where anyone can earn ETH scraping pages for people who'd rather pay a few cents than run the infrastructure themselves.
