Open Source · Actively Maintained

Your data pipeline.
Your infrastructure.
Your control.

Estela is the open-source spider orchestration platform that lets engineering teams deploy, schedule, and monitor web scraping at scale — on your servers or ours.

Cut infrastructure costs by owning your entire scraping stack
Deploy and schedule spiders via REST API in minutes
Full visibility into every job, project, and spider — in one place

Trusted by Engineering Teams Across Industries

Bitmaker Web Scraping
SMAT
Agrometrika
Plataforma Group
Emptor
1.1K+
Scraping Projects
Running Globally
5.96B+
Data Records
Extracted
99.8%
Enterprise-Grade
Reliability
12+
Years Building Web
Data Infrastructure

Stop managing scrapers.
Start extracting value.

Most scraping setups break under scale — fragmented tools, opaque costs, zero visibility. Estela was built to fix that.

One platform, all your spiders

Deploy and manage every spider from a single dashboard and REST API. No more scattered scripts and ad-hoc solutions.

💰

Costs you can predict

Pay precisely for CPU, memory, bandwidth, and storage. No black-box fees — whether self-hosted or on BMC.

📈

Scale without rewriting

Kubernetes under the hood means elasticity is built in from day one. Your architecture grows as your data needs do.

🔍

Full observability

Searchable logs, request tracking, execution metrics — all in one place. Find the exact point where a spider breaks.

🔓

Zero vendor lock-in

Open-source and self-hostable. Your pipeline, your servers, your rules. Migrate to BMC or back to your infra anytime.

🌐

Proxy-ready from day one

Bitmaker Proxy integrates directly into your pipeline — automatic rotation, optimal selection per project.

BMC — Bitmaker Cloud

Hosted.
Zero DevOps.

The managed instance of Estela. Start in minutes, pay only for what you run.

  • $5 in free credits to start
  • Pay-per-use: CPU, memory, storage, bandwidth
  • No infrastructure to maintain
  • Bitmaker Proxy built in
  • Backed by Bitmaker's 12+ years of expertise
Start Free on BMC →
Estela Commercial Support

Self-hosted.
Fully supported.

Deploy Estela on your own infrastructure with Bitmaker's installation, maintenance, and SLA-backed support.

  • Installation & configuration on your cluster
  • Standard, Professional & Enterprise tiers
  • SLA-backed incident response
  • Security patches & platform updates
  • Custom feature development available
Contact for Support →
Estela Enterprise

Your data infrastructure.
Backed by Bitmaker's
dedicated team.

Enterprise-grade deployment with full proactive supervision, dedicated account management, and guaranteed response times — so your team focuses on data, not infrastructure.

Contact for Estela Enterprise →
30-minute P1 response, 24/7 — Critical incidents handled around the clock
Dedicated Technical Account Manager — Your named Bitmaker engineer for reviews, escalations & planning
Dedicated Slack channel + scheduled calls — Direct line to Bitmaker's engineering team
Unlimited named contacts — No restrictions on who can open support tickets
Monthly health reports — Uptime %, incidents, jobs executed & scaling recommendations
Full proactive supervision — Kafka lag, MongoDB disk, CPU alerts before you notice anything

Everything your team needs
to extract data at scale

From deployment to scheduling to monitoring — Estela handles the orchestration so your team handles the insights.

01

Deploy via REST API

Push your spider with a single CLI command. Estela handles containerization, resource allocation, and execution environment automatically.

02

Schedule & automate

Set cron jobs, event triggers, or run on-demand. Your spiders run exactly when you need them — no extra configuration required.

03

From raw data to ready-to-use results

Every spider run surfaces extracted items directly in your dashboard. Review, filter, and validate before exporting as CSV — no extra tooling required.

04

Search logs & debug fast

Full execution history with searchable logs. Find the exact line where a spider breaks — without downloading anything.

05

Monitor in real time

Live logs, execution metrics, status per job. Full visibility into every spider's performance — without digging through server logs.

06

Transparent usage & costs

See exactly how much CPU, memory, storage, and bandwidth every project consumes. No surprises at the end of the month.

Up and running
in three commands

Whether deploying to BMC or your own infra, the Estela CLI gets you from zero to running spider in minutes.

bash · estela-cli
# 1. Install the Estela CLI
pip install estela
Successfully installed

# 2. Authenticate with your BMC account
estela login
Host [http://localhost]: https://api.cloud.bitmaker.dev
Username: new-user # your user
Password:
Successful login. API Token stored in ~/.estela.yaml.

# 3. Initialize your project
estela init 58ba987c-06a7-402c-9084-b137517f28e0 # Your project ID shown in bmc - deploy page
58ba987c-06a7-402c-9084-b137517f28e0 is initialized as a Scrapy project.
estela.yaml file created successfully.
.estela/Dockerfile-estela created successfully.

# 4. Deploy your spiders
estela deploy
58ba987c-06a7-402c-9084-b137517f28e0.zip: 13.3kB [00:02, 6.61kB/s]
✓ Project uploaded successfully.
BMC — Bitmaker Cloud

Start scraping in minutes

Create your BMC account and get $5 in free credits. No credit card required. Deploy your first spider today.

Start Free on BMC →
Estela Commercial Support

Run Estela on your infrastructure

Installation, maintenance, and SLA-backed support from Bitmaker. Standard, Professional, and Enterprise tiers available.

Contact for Support →