Estela gives you a production-grade web scraping platform built for teams that need full control over their web data infrastructure.
"We built Estela around a single principle: open exchange of information, technology, and collaborative development."
— Bitmaker teamBitmaker has been building web data infrastructure for over 12 years. Making Estela open source was a natural extension of that work — a way to give back to the developer community we've been part of, and to build something better through transparency and collaboration than we ever could behind closed doors.
Every line of Estela's code is public. Audit it, fork it, and understand exactly how your data pipeline works.
The best ideas for Estela have come from the people using it. We build in public so the community shapes what comes next.
MIT licensed. Deploy it anywhere, modify it freely, move on without friction. That's the deal.
Estela is built as a small set of independent pieces that work together to take your spiders from deployment to running data extraction at scale.
Push your Scrapy project with the CLI or the Web UI. Estela packages it and stores it as a versioned image, ready to run on demand.
The brain of Estela. It manages your projects, schedules jobs, and tells the cluster when and how to run each spider.
Each spider runs isolated as a Kubernetes job, with its own resources. Scale to many parallel runs without spiders stepping on each other.
As spiders scrape, items, requests, and logs stream through a high-throughput pipeline and land in storage — ready to query or export.
Estela runs on any Kubernetes cluster — on-premise, AWS, GCP, or Azure. For on-premise and local environments, the CLI handles configuration and deployment on its own. Deploying on AWS, GCP, or Azure requires Estela Commercial Support.
Estela is MIT-licensed and open to contributions of all kinds — from bug fixes to new features to documentation improvements.
Found something broken? Open a GitHub issue with steps to reproduce, expected behavior, and a minimal sample when possible.
Open an issue →Fork the repo, create a branch from main, and follow the PR template. All submissions go through review.
Have an idea for Estela? Open an issue tagged enhancement and describe the use case. We read every proposal.
Bitmaker deploys, configures, and maintains Estela on your servers. SLA-backed support, dedicated engineering access, and custom development — so your team ships data pipelines, not DevOps.