Published inDevOps.dev·PinnedReduce Amazon EKS cost by scaling node groups to zeroAmazon EKS just released the support for Kubernetes version 1.24. The new version supports a bunch of cool features. My favorite feature in this release is the ability to scale EKS managed node groups to (and from) zero. Many customers I engage with have workloads that don’t run continuously. A…Amazon Eks6 min readAmazon Eks6 min read
Published inDevOps.dev·PinnedUsing eStargz to reduce container startup time on Amazon EKSA container image bundles executable code, library, and configuration. Images contain everything an application needs to run. It is a best practice to exclude any file that’s unnecessary for the application packaged in the image. …Kubernetes7 min readKubernetes7 min read
Published inITNEXT·Jun 23Cert-Manager: Encrypt Kubernetes service to service communication with private CA and self-signed certificatesCert-manager is an open-source certificate management solution for Kubernetes clusters. It automates the issuance, renewal, and management of SSL/TLS certificates within a Kubernetes environment. Cert-manager is crucial in securing communication between services, encrypting HTTP traffic, and establishing secure connections to external systems. Cert-manager integrates with popular certificate authorities (CAs) such…Kubernetes9 min readKubernetes9 min read
Published inITNEXT·May 23Run more pods per GPU with NVIDIA Multi-Instance GPUPhoto by Pawel Czerwinski / Unsplash Machine learning (ML) workloads require tremendous amounts of computing power. Of all the infrastructure components that ML applications require, GPUs are the most critical. With their parallel processing capabilities, GPUs have revolutionized domains like deep learning, scientific simulations, and high-performance computing. But not all…Amazon Eks10 min readAmazon Eks10 min read
Published inITNEXT·Apr 5Use containerd to handle k8s.gcr.io deprecationPhoto by David Mullins / Unsplash The Kubernetes community is getting ready for yet another major change. Until the fall 2022, k8s.gcr.io container registry hosted many Kubernetes community-managed container images like Cluster Autoscaler, metrics-server, cluster-proportional-autoscaler. The "gcr.io" is Google Cloud Registry. …Kubernetes5 min readKubernetes5 min read
Nov 24, 2022Book Review: Chip War — Chris MillerChris Miller’s biography of semiconductors appears on the bookshelves amid wars in Ukrain and Syria, tensions in South China Sea, and a period of political turmoil with price of bread skyrocketing in Europe. Earlier in 2022, the Biden government committed $52 billion in subsidies to build new chip factories in…Book Review8 min readBook Review8 min read
Published inTowards AWS·Nov 3, 2022Autoscale Kubernetes Metrics Server on Amazon EKSMany organizations are happy to standardize their infrastructure platform on Kubernetes. Kubernetes gives engineers a consistent platform across cloud providers and on premises. It abstracts underlying infrastructure so engineers can focus on writing code without having tight-coupling with methods for load balancing, observability, configuration, secrets management. I frequently speak with…Kubernetes6 min readKubernetes6 min read
Oct 9, 2022Handling FeedbackPhoto by Sushobhan Badhai / Unsplash Accepting feedback with grace plays a key role in building long lasting productive relationships. Humans are social creatures and feedback fuels our psyche. We nod when we see our colleagues in the hallway. Sometimes multiple times a day. …6 min read6 min read
Published inDevOps.dev·Jun 23, 2022How is eBPF efficient for observabilityEverybody knows eBPF is fast, but how? — The Berkeley Packet Filter (BPF or eBPF) is a virtual machine based on registers, initially designed for filtering network packets, best known for its use in tcpdump. In this post, we learn what is exactly that makes BPF so appealing for a number of use cases. Introduction BPF programs are…Linux3 min readLinux3 min read
Published inDevOps.dev·May 26, 2022Closing observability gaps with custom metricsWhich application metrics should you track? I frequently engage with customers that are amid breaking their monolithic applications into smaller microservices. Many teams with also see this migration as an opportunity to make applications more observable. …Observability7 min readObservability7 min read