this post was submitted on 15 Jun 2023
9 points (100.0% liked)

Data Engineering

259 readers
1 users here now

News and discussion on Data Engineering topics

founded 1 year ago
MODERATORS
[email protected]
9
Data Engineering roadmap (lemmy.ml)
submitted 1 year ago by [email protected] to c/[email protected]
4 comments fedilink hide all child comments
 

What needs to be added for 2023

top 4 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 1 year ago (1 children)

Isn’t Apache Arrow a table format rather than a batch processing tool?

You could add SQLMesh as an alternative to dbt.

[–] [email protected] 1 points 1 year ago

thanks for suggesting sqlmesh. regarding arrow, have you read this - https://arrow.apache.org/docs/format/Columnar.html

[–] [email protected] 1 points 1 year ago (1 children)

btw, you've spelt Engineering wrong in the sidebar.

[–] [email protected] 1 points 1 year ago

thanks for pointing out. fixed.