data-engineering
| Date | Project Name | 🎉 | ? | Tags |
|---|---|---|---|---|
| 11/06 |
DataKitchen Data Observability Installer latest
* [DataKitchen Data Observability Installer latest](https://github.com/DataKitchen/data-observability-installer) – Installer and quickstart setup for DataKitchen's data quality and observability product suite.
Installer and quickstart setup for DataKitchen's data quality and observability product suite.
|
4
|
Python 128 ⭐567 days old |
python data data-engineering data-observability data-quality data-profiling |
| 11/06 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
3
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 11/05 |
Dataform Core 3.0.37
* [Dataform Core 3.0.37](https://github.com/dataform-co/dataform) – Meta-language extending SQL for creating tables and workflows with dependency management and data quality testing in BigQuery.
Meta-language extending SQL for creating tables and workflows with dependency management and data quality testing in BigQuery.
|
5
|
TypeScript 935 ⭐2621 days old |
typescript analytics data-engineering business-intelligence data-pipelines elt |
| 11/05 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
3
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 11/04 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
3
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 11/03 |
qsv 9.1.0
* [qsv 9.1.0](https://github.com/dathere/qsv) – Command line program for querying and transforming tabular data quickly.
Command line program for querying and transforming tabular data quickly.
|
8
|
Rust 3281 ⭐1792 days old |
cli rust csv data-wrangling opendata data-engineering ckan |
| 11/02 |
lakeFS v1.71.0
* [lakeFS v1.71.0](https://github.com/treeverse/lakeFS) – Tool that transforms object storage into a Git-like repository for managing data lakes.
Tool that transforms object storage into a Git-like repository for managing data lakes.
|
8
|
Go 4956 ⭐2246 days old |
go data-engineering data-versioning object-storage data-lake |
| 11/01 |
Dataform Core 3.0.36
* [Dataform Core 3.0.36](https://github.com/dataform-co/dataform) – Meta-language extending SQL for creating tables and workflows with dependency management and data quality testing in BigQuery.
Meta-language extending SQL for creating tables and workflows with dependency management and data quality testing in BigQuery.
|
5
|
TypeScript 935 ⭐2621 days old |
typescript analytics data-engineering business-intelligence data-pipelines elt |
| 11/01 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
3
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 10/31 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
2
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 10/30 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
2
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 10/29 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
2
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 10/28 |
Multiwoven v0.85.0
* [Multiwoven v0.85.0](https://github.com/Multiwoven/multiwoven) – Simplifies self-hosting a secure, scalable Reverse ETL platform on cloud infrastructure.
Simplifies self-hosting a secure, scalable Reverse ETL platform on cloud infrastructure.
|
7
|
Ruby 1627 ⭐745 days old |
ruby etl data-pipeline data-engineering reverse-etl data-activation |
| 10/28 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
2
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 10/25 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
2
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |
| 10/24 |
Conduit v0.15.0-nightly.2025...
* [Conduit v0.15.0-nightly.2025...](https://github.com/ConduitIO/conduit) – Data streaming tool for building and running real-time data pipelines with connectors and processors.
Data streaming tool for building and running real-time data pipelines with connectors and processors.
|
2
|
Go 564 ⭐1395 days old |
go etl data-integration data-pipeline data-engineering |