Serving an LLM on Kubernetes: slow starts, heavy weights and the right scaling signal.
Why a model server breaks the defaults you use for web apps, and how to set probes, model storage, autoscaling and routing for AI inference.
FIELD NOTES / KUBERNETES
Kubernetes
Deploy, debug, and understand what is happening inside your cluster.
A GPU is not a bigger CPU. Schedule it like one and your pod waits.
How Kubernetes actually allocates GPUs to AI workloads: whole devices, taints, sharing with isolation in mind, and Dynamic Resource Allocation.
Your pod is stuck. Here's where to look first.
A calm, practical checklist for debugging Kubernetes pods—before you reach for another restart.