Hey Reader 👋🏽
This week I'm bringing back one of our most-read posts: the 3 levels of AWS observability. A lot of you joined after it went out in May, and the topic fits this week perfectly.
Because the real question isn't "do I have logs?" anymore. It's "who actually knows what they mean?" 👇🏽
Sponsored by Dynatrace. These are my own words.
📚 From the Archive
In 2022 I joined a startup with 100 million API requests a month. All on AWS, all logs in CloudWatch. I loved it. Then the first incident hit. My boss was looking over my shoulder, and I didn't even know which log stream to open. As a self-claimed AWS expert. Level 1: Log HellWe had logs, metrics and some traces. All unstructured plain text, spread over different log streams. When a customer reported a missing order, we searched strings and compared timestamps by hand. You cannot skip a levelOver the years I went through three levels of AWS observability. Each one builds on the one before. Most teams stop at Level 2, and that is the level that makes everything after it possible. Level 3 is where I stopped opening the console. What does it take to get there, and why does it fail without Level 2? |
📰 This Week in AWS🌐AWS Lambda Web Functions
🔀CloudWatch log routing and chained parsers
🔁Lambda loop detection for EventBridge custom buses
|
That's it for this week.
Where is your team right now: Level 1, 2 or 3? Hit reply and tell me, I read every answer.
See you next week,
Sandro & Tobi
|
Sandro Volpicella & Tobias Schmidt from AWS Fundamentals |
We teach AWS for the real world - not for certifications. Join more than 10,500 developers learning how to build real-world applications on AWS.
AWS FOR THE REAL WORLD ⏱️ Reading time: 10 minutes 🎯 Main Learning: Every convenience layer AWS built on ECS is dead or dying, while ECS itself has not changed since 2014. Build on the primitive, and make the layer above it prove itself first. 📝 Blog Post Hey Reader 👋🏽 Getting started with an AWS service often feels more complicated than it should. Four concepts must be understood before a single container runs. A VPC is required before a single request. So, the fancy CLI that promises to do...
⏱️ Reading time: 21 minutes 🎯 Main Learning: Same CloudFront logs: 12.5s through Kinesis, S3, Glue and Athena, about 1s through Tinybird's managed ClickHouse. 📝 Blog Post Hey Reader 👋🏽 We've been running Plausible for the analytics on awsfundamentals.com. Good software, no complaints. We still wanted the data to be ours: our retention, our schema, nobody's script in the visitor's browser. So we built the dashboard ourselves. Twice, on two different backends, fed by the same CloudFront logs....
AWS FOR THE REAL WORLD ⏱️ Reading time: 11 minutes 🎯 Main Learning: A Karpenter NodePool is a placement policy, not an instance preference. Pin one instance family, and a Spot shortage moves your fleet across availability zones, where every internal call starts costing $0.01 per GB. 📝 Blog Post Hey Reader 👋🏽 Important off topic things first: Sandro got married! 🎉We were in Munich for it and it was a fantastic day! ☀️Highly recommend a wedding over sprint planning or fighting with AWS...