The Tech Caffeine #34: This Week in Tech
📚 A non-standard book list for software developers, 🎼 Why Spotify Switched Their Data Orchestration Service, 👉 A Framework for Evaluating Your Software Supply Chain Security
Dear Readers,
We have now completed 34 weeks! If you have enjoyed the content of The Tech Caffeine, would you mind recommending it to your friends/colleagues or posting it on your Twitter/LinkedIn account? I appreciate your help! Have a great time with this issue!
📚 A non-standard book list for software developers
I view the field of software development as a big logical system with highly interconnected and complex parts. Understanding such a big system naturally requires having an excellent grasp of the tools used to build them. And the most fundamental one is logic itself.
The following book list contains titles that are all playing fields for one to start experimenting with such systems and gain the required confidence that one can master them.
🎼 Why Spotify Switched Their Data Orchestration Service
Within Spotify, we run 20,000 batch data pipelines defined in 1,000+ repositories, owned by 300+ teams — daily. The majority of our pipelines rely on two tools: Luigi (for the Python folks) and Flo (for the Java folks). In 2019, the data orchestration team at Spotify decided to move away from these tools. In this post, the team details why the decision was made, and the journey they took to make the transition.
🤔 What is the responsibility of an engineering manager?
The article explains how Ganesh Sridharan came upon a straightforward description of what an Engineering Manager should do.
🕵🏻♂️ Google Open Sources Community Security Analytics Queries
As organizations go through the Autonomic Security modernization journey, this repository serves as a community-driven list of sample security analytics for auditing cloud usage and for detecting threats to your data & workloads in Google Cloud. These may assist detection engineers, threat hunters, and data governance analysts.
If you are an existing Google Cloud Platform(GCP) customer then this is a great repository for your security command operations center.
👉 A Framework for Evaluating Your Software Supply Chain Security
In recent years, Software Supply Chain Attacks have been on the rise, so this guide from Cloud Native Computing Foundation(CNCF) is a great way to understand your Software Supply Chain posture.
✅ Best Practices for Running Stateful Applications on Kubernetes
This article explains the importance of running stateful applications in Kubernetes, presents three options for running stateful workloads, and describes these mechanisms in more detail.