DAGWorks-Inc/hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

40 best points · 11 comments · 3 Hacker News posts · 2,624 GitHub stars · View on GitHub

Hacker News discussions

• Show HN: Hamilton's UI – observability, lineage, and catalog for data pipelines (40 points, 10 comments, by elijahbenizzy, 2024-05-02)
• Show HN: Declarative Spark Transformations with Hamilton (4 points, 0 comments, by elijahbenizzy, 2023-08-24)
• Show HN: On Garbage Collection and Memory Optimization in Hamilton (2 points, 1 comments, by elijahbenizzy, 2023-10-24)