What I Build
Open-source packages anyone can install or read, and the private production systems beside them. Each is described by what it does when something goes wrong.
The Packages: open-source, each installed from PyPI. dagster-dex lets dex, an open-source tool that lets an agent explore a warehouse, read a Dagster asset graph the way it reads a dbt project. ration grants a bounded claim on a finite shared pool, for a period. crosslink reduces an asset graph to a project format, with the write path back to the code. ration and crosslink are alpha.
Catalyst Engine: the private data engine the estate runs in production. Every day it reads a set of APIs, transforms what they return and writes the result to a warehouse in Google Cloud, unattended. One of its cost tables once reported zero for one provider on days with real spend while every check passed. It now recomputes a reporting table's values from the data it was derived from and compares the two.
The dex Service: a private checkpoint that lets an agent ask the warehouse a question without being handed the warehouse. Each query passes a SQL firewall, a PII policy and a byte-budget check before the warehouse runs it, and a refused query comes back with a status the caller can branch on.