When does serverless stop being the answer?


AWS FOR THE REAL WORLD
⏱️
Reading time: 11 minutes
🎯
Main Learning: Most teams should stay serverless. EKS only pays off at real scale.
πŸ“

Hey Reader πŸ‘‹πŸ½
For years we told everyone the same thing: don't run Kubernetes!

And we meant it. Running k8s yourself is a second full-time job. Cluster upgrades, etcd backups, some networking plugin that falls over on a Tuesday and nobody can say why.
We're serverless people through and through. Lambda first, a queue behind it, scale to zero, go home! πŸ’ͺ
And when something won't fit in a function, we still don't jump to clusters. ECS on Fargate is our happy place: steady long-running jobs, containers just humming along, no servers to patch! A battle-tested service! πŸ₯°
So consider this our plot twist: There's a point where EKS is genuinely the right move, and we want to show you exactly where that line sits.
That's this issue: what to do when serverless runs out of road!

Sponsored by Trigger.dev
Open Source

AI agents and workflows, in plain TypeScript.

Running AI agents or long jobs in prod means retries, queues, stuff timing out. Trigger.dev handles all of it: you write normal TypeScript, it runs durably with no timeouts.

Best part: no separate service to run. It's an npm install into the repo you already have, streams output to your frontend, shows task status live, and it's properly open source.

Your app sends work to Trigger.dev durable tasks, which call the AI agent and stream results back in real time

This issue is sponsored by Trigger.dev.

Getting started with EKS β€” when serverless stops being the answer

πŸ“š This Week's Deep Dive

EKS used to be an instant no from us. Running Kubernetes yourself means babysitting a control plane at 3am, and we'll take Lambda and a queue over that any day. But at a certain scale the math flips, and we finally get why teams reach for it.

The compute ladder

We pick compute in a fixed order. Lambda first. If the work doesn't fit a function, drop down to containers on Fargate. Small team, a handful of services? That's the whole story. Stop there, you're done.

Where it breaks

Then you scale, and the ladder snaps. A JVM service that needs 90 seconds to warm up. A model server that wants a GPU. A vendor tool that only ships as a Helm chart. None of that fits a function. Now hand 30 teams their own setup and watch one security fix turn into a pull request in 30 repos. Run hundreds of services flat out and the Fargate premium stops feeling convenient and starts feeling like money you're lighting on fire.

EKS is not self-managed Kubernetes

Here's what changed our minds. Every nightmare up top, the control plane, the etcd backups, the 3am upgrades, comes from running Kubernetes yourself. EKS hands all of it to AWS. They run the control plane across AZs and charge you ten cents an hour for it. That's 73 bucks a month. For an org with hundreds of services that's a rounding error, and the thing that used to need a whole team is now a line on the bill.

That's the part that flipped us. The rest of the post is the actual blueprint: Flux syncing everything from Git, Karpenter picking your nodes and parking most of them on Spot to gut the bill, and the trick that lets a brand-new cluster boot itself. Plus the spots where it bites.

πŸ“° This Week in AWS

πŸ”AWS Workload Credentials Provider

You know how it goes: certs expire, and some cron job is quietly on the hook for renewing them right up until the day it isn't. AWS shipped an open-source agent that takes over. It pushes ACM certs and caches Secrets Manager secrets onto your boxes, on AWS or off, Linux or Windows, Apache or NGINX. Cert lifetimes keep getting shorter, so that's one less thing breaking at the worst possible moment. Read More β†’

πŸ’°AWS FinOps Agent (preview)

The bill jumps and there you are, spelunking through Cost Explorer trying to work out what happened. AWS wants an AI agent to take that off you. Ask it cost questions, let it dig for savings, and it'll chase down spend spikes on its own. It hooks into Slack and Jira, so ideally the "who blew the budget" thread sorts itself out. Preview for now, but worth a look. Read More β†’

That's a wrap for this one.
One thing to take with you: don't argue about whether Kubernetes is good or bad. Ask whether you've got the scale and the people to make the overhead pay off. If you have to ask, you probably don't, and that's completely fine.​
Serverless first! EKS when you run out of the ladder. πŸ˜‰

Catch you in the next one!

Sandro & Tobi

AWS for the Real World

We teach AWS for the real world - not for certifications. Join more than 10,500 developers learning how to build real-world applications on AWS.

Read more from AWS for the Real World

⏱️ Reading time: 15 minutes 🎯 Main Learning: A public container on AWS for $7 a month, with no VPC to own. πŸ“ Blog Post 🀝 Sponsored by AWS. What we built, what it cost and what we think of it are our own. Hey Reader πŸ‘‹πŸ½ Your first container on ECS comes with homework: a VPC, subnets in two Availability Zones, a load balancer, security groups, a certificate and a task role. Express Mode creates most of it for you now (App Runner's successor, so ECS abstraction number three), but it all lands in...

AWS FOR THE REAL WORLD ⏱️ Reading time: 6 minutes 🎯 Main Learning: You cannot skip a level of AWS observability. Structured logs come first, then the AI agent that reads them for you. πŸ“ Blog Post πŸ“‚ Claude Code agent (free gist) 🎬 Watch on YouTube Hey Reader πŸ‘‹πŸ½ This week I'm bringing back one of our most-read posts: the 3 levels of AWS observability. A lot of you joined after it went out in May, and the topic fits this week perfectly. Because the real question isn't "do I have logs?" anymore....

⏱️ Reading time: 11 minutes 🎯 Main Learning: Measure NAT traffic first. CI runners rarely need NAT at all. πŸ“ Blog Post Hey Reader πŸ‘‹πŸ½ NAT Gateways are one of those things you set up once and never look at again (probably!) πŸ˜… Until NatGateway-Bytes shows up near the top of the bill, filed under EC2-Other - thanks AWS! I think they've made this on purpose to hide these significant networking related costs somewhere and made it hard to reflect on! The hourly fee is predictable, sure. But the...