Firecrawl's Alexandria Data Library Is Missing From Its 205,955-Star Repo
Software / news
Firecrawl's Alexandria Data Library Is Missing From Its 205,955-Star Repo
The AGPL-3.0 repository covers scraping and a self-hosted server, while the 550-provider data library and search run on Firecrawl Cloud.
The firecrawl/firecrawl repository, which had 205,955 GitHub stars on Nov. 21, is licensed primarily under AGPL-3.0, and its README says the headline data product, Alexandria, is not in the self-hosted server. The repo gained 999 stars on one day, according to GitHub trending.
Firecrawl describes itself as "knowledge infrastructure" for AI agents and offers three routes: Firecrawl Cloud, a self-hosted server run from apps/api with Docker Compose, Redis and PostgreSQL, and Firecrawl Local. The repository was created Apr. 15, 2024, and shows 10,770 forks and 899 open issues. Its latest tagged GitHub release is v2.11.0 from June 19, so the README describes more than the last tag ships.
Which parts are AGPL
The README says the project is "primarily licensed under the GNU Affero General Public License v3.0", with the SDKs and some UI components under MIT. The AGPL's network clause is the part that matters for a server. Choose a License summarises section 13: if you modify the program, you must offer all users interacting with it remotely through a network a way to get the source.
| Component | Licence | Where stated |
|---|---|---|
| Server and most code | AGPL-3.0 | README, "License" section |
| SDKs, some UI parts | MIT | README, "License" section |
| firecrawl-local 0.1.1 | AGPL-3.0 | apps/local/Cargo.toml |
A company that runs an unmodified server internally has no disclosure duty under that summary. One that modifies it and exposes it to customers does. The README does not discuss this; check with counsel before deciding.
What Firecrawl Local sends out
Firecrawl Local scrapes, crawls and maps from your machine and installs from crates.io, which means Rust and a C compiler. Its README says that by default a single-page scrape that will not load locally is fetched by Firecrawl Cloud and marked "source": "firecrawl-cloud" in the result. Those calls work without an account at a limited rate. Setting FIRECRAWL_CLOUD=off keeps everything on the machine. Search and Alexandria also route through Cloud.
The serve command defaults to 127.0.0.1 and refuses localhost and private addresses unless --allow-private is passed. Binding another address with --host requires --token.
What stays in the cloud
Alexandria is described as 550+ data providers, including 250M+ people, 75M+ companies and 41M+ research papers. Those are Firecrawl's own figures and The Terminal did not check them. The README says "Alexandria runs on Firecrawl Cloud, so the self-hosted server does not include it". The Local README lists Search as available through Cloud with no account needed, and Alexandria only after firecrawl-local login. Firecrawl Keyless offers 1,000 free credits a month without an API key or signup.
The self-hosting file, SELF_HOST.md, recommends starting with USE_DB_AUTHENTICATION=false and warns that changing the variable alone is not a complete authenticated deployment.
Other trending agent repositories get the same treatment in our reporting on Claude-BugHunter's pattern counts and OpenComputer's Devin comparison.
The number to watch is the next tagged release after v2.11.0, since the Local tool's docs already live on main.
Sources
More in Software
- 01Brazil's Receita Federal Posts Tax Calculator Under MIT With 16 Open IssuesThe agency published three repositories on Nov. 16 for the new consumption taxes, and outside developers had filed bug reports against the first within days.
- 02OpenSRE Hits 13,884 Stars After Repositioning Toward CI/CD FailuresThe Apache-2.0 agent is labelled public alpha, ships a dated release almost every day, and sends analytics and crash reports unless users set an environment variable.
- 03Microsoft 365's 1,430-Minute Outage Traces to a July Windows ChangeMicrosoft's preliminary report blames a latent lock-contention defect, a Teams failover and 14 percent of gateway capacity already offline, and customers have until the end of December to claim service credits.
- 04Vim Classic 8.3.1 Backports Patches to 8.2.3237 and Drops Python 2The AI-free Vim fork's second release is signed by Drew DeVault, and its announcement does not say which CVEs the new patches fix.