{"id":554,"date":"2026-11-20T06:43:58","date_gmt":"2026-11-20T06:43:58","guid":{"rendered":"https:\/\/blockoala.com\/index.php\/2026\/11\/20\/how-cloudflare-redesigned-d1s-control-plane-for-millions-of-databases\/"},"modified":"2026-11-20T06:43:58","modified_gmt":"2026-11-20T06:43:58","slug":"how-cloudflare-redesigned-d1s-control-plane-for-millions-of-databases","status":"publish","type":"post","link":"https:\/\/blockoala.com\/index.php\/2026\/11\/20\/how-cloudflare-redesigned-d1s-control-plane-for-millions-of-databases\/","title":{"rendered":"How Cloudflare redesigned D1\u2019s control plane for millions of databases"},"content":{"rendered":"<p>As reported on November 20, 2026, Cloudflare described a redesign of the control plane for D1, its SQLite-based serverless SQL database. First released in 2022, D1 runs on Cloudflare\u2019s global network. Cloudflare said the number of daily active D1 databases had grown 18-fold over the preceding year, making bottlenecks in centralized management a concern.<\/p>\n<p>The redesigned architecture separates query handling at the edge from management operations. Postgres holds transactional metadata and serves as the source of truth for database existence and account quotas. ClickHouse handles analytics, while Workers KV stores globally replicated routing data. Distributed metadata caching, connection pooling, asynchronous workflows and periodic health checks support the control plane.<\/p>\n<p><strong>Keeping queries off the centralized database.<\/strong> Query requests pass from an Edge API Worker to an Eyeball Worker, which routes them directly to the appropriate D1 Durable Object rather than through Postgres. The Edge API Worker handles authentication, authorization, rate limiting and request validation. The Eyeball Worker relies on database-specific authorization encoded in D1 Bindings, avoiding a second authorization check on the query path.<\/p>\n<p>Cloudflare engineers David Laban and Lambros Petrou explained why routing data lives in Workers KV rather than only in a cache: if an edge-cached entry is evicted, KV can serve the read from its own storage instead of sending it to Postgres. They warned that a large-scale cache purge could otherwise cause millions of databases to request routing information from Postgres at once.<\/p>\n<figure><img decoding=\"async\" src=\"https:\/\/blockoala.com\/wp-content\/uploads\/2026\/11\/0sKm-umkZTY-YYRHuENhK.jpg\" alt=\"How Cloudflare redesigned D1\u2019s control plane for millions of databases\"><\/figure>\n<p><strong>Recovering from incomplete updates.<\/strong> Each D1 Durable Object checks its state against Postgres on a 30-second heartbeat, with randomized timing to spread the load. According to Cloudflare, this can mark orphaned Durable Objects as deleted and repair routing metadata in Workers KV when a best-effort update fails. The checks can tolerate slightly delayed data, allowing them to use Hyperdrive\u2019s caching layers or Postgres read replicas.<\/p>\n<p>For storage quotas, usage updates enter a queue and are processed in batches instead of producing bursts of Postgres writes. Incremental storage changes maintain pre-aggregated account totals, avoiding full scans for accounts with millions of databases. Durable Objects check those totals through a short-lived Hyperdrive cache and block writes that could exceed an account\u2019s storage quota.<\/p>\n<p>The report also noted discussion of D1\u2019s production reliability among Reddit users; those concerns are user assessments, not a demonstrated outcome of this redesign. As of the November 20 report, D1\u2019s free tier included 5 GB of total storage, 5 million rows read per day and 100,000 rows written per day. Beyond the free allowance, the reported prices were $0.75 per GB of storage per month, $0.001 per million rows read and $1 per million rows written, with no compute or data-transfer charges.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>As reported on November 20, 2026, Cloudflare described a redesign of the control plane for D1, its SQLite-based [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":552,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-554","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/posts\/554","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/comments?post=554"}],"version-history":[{"count":0,"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/posts\/554\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/media\/552"}],"wp:attachment":[{"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/media?parent=554"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/categories?post=554"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blockoala.com\/index.php\/wp-json\/wp\/v2\/tags?post=554"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}