ephemeral404

joined 1 year ago
MODERATOR OF
dataengineering
sorted by: new top controversial old
Would being a Linux "power user" increase my chances of getting a job in IT/tech? in c/[email protected]
[–] [email protected] 20 points 3 months ago* (last edited 3 months ago) (4 children)

If you're applying to work with my team. A big Yes.

Seeing a developer use Windows is a big turn off, I can clearly see all the future dev environment problems I'd need to assist them with.

And if you understand linux permissions, the architecture, bash, common tools, etc. I can envision how you will make the dev experience better for everyone and contribute to fix any deployment issues. Unlike windows, you won't be introducing ovearching solutions to problems which can be solved with a simple bash script.

165
The job description vs reality (lemmy.ml)
 
In five years time, some CTO will review the mysterious outage or technical debt in their organisation. in c/[email protected]
[–] [email protected] 11 points 8 months ago

Not five years, but this year itself

17
Who wants clean data? (lemmy.ml)
 
RudderStack - An Open-Source alternative to Google Tag Manager in c/[email protected]
[–] [email protected] 0 points 1 year ago (1 children)

Yes, RudderStack has all Segment fratures and a good replacement of the same. I never knew if Matomo has GTM functionality, I thought it is more like Google Analytics.

Data Engineering roadmap in c/[email protected]
[–] [email protected] 1 points 1 year ago

thanks for suggesting sqlmesh. regarding arrow, have you read this - https://arrow.apache.org/docs/format/Columnar.html

Data Engineering roadmap in c/[email protected]
[–] [email protected] 1 points 1 year ago

thanks for pointing out. fixed.

Data Vault 2.0 Advanced Material in c/[email protected]
[–] [email protected] 1 points 1 year ago

Have you tried Datavault YouTube channel?

3
Lemmy alternative to r/dataengineering (lemmy.ml)
3
33 data offerings by AWS, Azure, Google Cloud (lemmy.ml)
 

3
This one never gets old (lemmy.ml)
 

9
Data Engineering roadmap (lemmy.ml)
 

What needs to be added for 2023

Reddit refugees, has your favorite sub migrated already? in c/[email protected]
[–] [email protected] 2 points 1 year ago* (last edited 1 year ago)

Created !dataengineering Inviting all the data engineers at Lemmy to join the community

3
Welcome to the community, want to join the mod team? (lemmy.ml)
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
1 comments fedilink
 

Fellow data engineers, looking forward to your contribution/participation to the communiy. If you want to help in managing the community, get in touch to join the team

RudderStack - An Open-Source alternative to Google Tag Manager in c/[email protected]
[–] [email protected] 1 points 1 year ago

Glad to help. Can't wait to see you purge that last piece of Google code.

8
RudderStack - An Open-Source alternative to Google Tag Manager (github.com)
 

With recent GA4 migration, my friends are exploring better ways to integrate various essential website scripts(e.g. product analytics, crash reporting, advertising, customer engagement, etc.). Google Tag Manager (GTM) is one solution.

RudderStack is a mature Open-Source alternative to GTM that can be self-hosted and has similar functionality i.e. load various product scripts without changing code and send events to desired destinations

Top 5 reasons to replace GTM with RudderStack

  • You get full-control of your customer data while making the site/app load faster as you don't have to load multiple scripts
  • As you can load and manage scripts via a central dashboard, it becomes easy, quick, and less error prone to replace any particular script with its alternative e.g. replacing Google Analytics (GA) with GA4 or Mixpanel
  • It is OSS and not owned by Google
  • Tranformations: Transform the events(using your own JS/python code) the way you want before reaching the destination e.g. remove personally identifiable information, enrich event data with some 3rd party information
  • Can send customer data from website and mobile apps(using RudderStack SDKs) to warehouses(Postgres, S3, Redshift, Sbowflake, Bigquery, etc.) and 200+ destinations

More details on GitHub repository - https://github.com/rudderlabs/rudder-server

Ask me anything

What open source project(s) are you working on? in c/[email protected]
[–] [email protected] 4 points 1 year ago

RudderStack, a headless customer data platform. With RudderStack, you can bring all your customer data/events from to a single warehouse in real time. You can then send the unified data to 200+ destination for user anaytics and personalization. You can do so in a privacy-focused manner using data transformation feature to mask/delete PII/sensitive data

Source code : https://github.com/rudderlabs/rudder-server License : AGPLv3

What open source project(s) are you working on? in c/[email protected]
[–] [email protected] 1 points 1 year ago (1 children)

quite interesting. never heard of such project before. are there any other purely software based solutions?

7
#OpenSourceDiscovery 78 - ntfy.sh, send notifications from cli/api/app (opensourcedisc.substack.com)
 

This week's issue of newsletter - #OpenSourceDiscovery  covered… ntfy.sh

A simple HTTP-based pub-sub service to send notifications to your phone or desktop via scripts from any computer

📺 Demo: https://docs.ntfy.sh 

👨‍💻 Source: https://github.com/binwiederhier/ntfy 

🛠 Stack: Go, Javascript, FCM, Amazon SES, UnifiedPush

👑 Author: Philipp C. Heckel

🛡 License: GPLv2

💖 What I like:

  • Easy self-hosting thanks to plenty of installation options and minimal configurations required to get started
  • Ability to attach files to notifications enables a huge number of use cases for this service

👎 What I dislike:

  • Good for personal use case (when I as an end-user want to get notifications) but better tools are available for developer use case (when I want to send notifications from my app to users at scale)

Note: This is a summary of this full post

What are your thoughts?