RetroFed Forum
Your home away from modern life.
Building a Data Pipeline from Scratch
Post Reply
AuthorMessage
Andy lemmy.world nydas@lemmy.world
Joined: 2023-06-12
Quote

I’ve written a series of Medium articles on creating a Data Pipeline from scratch, using Polars and DeltaTables. The first (linked) is an overview with link to the GitHub repository and each of the deeper dive articles. I then go into the next level of detail, walking through each component.

The articles are paywalled (it took time to build and document), but the link provided is the ‘family & friends’ link which bypasses the paywall for the Lemmy community.

I hope some of you may find this helpful.

1   Original
Post Reply
Back to top