Cloud Devops Automation

A practical guide to designing NodePool tiers, weights, taints, and disruption policies based on what actually worked for us in production. Why I Am Writing This Most Karpenter content online falls into two buckets. One is the AWS documentation, which is accurate but does not help you make architectural decisions. The other is the "Hello World" blog post that shows a single NodePool with one instance category and stops there. Neither helped us when we had to run a cluster with mixed workloads, where some pods needed memory-heavy nodes for Elasticsearch and JVM apps, some needed compute-heavy nodes for batch processing, some were latency sensitive web services, and a few were GPU workloads that we did not want anywhere near the rest of the cluster. So we ended up designing a five-tier NodePool architecture. It has been running in production for a while now and has survived enough incidents that I trust it. This post walks through the design, why each decision was made,...

  This guide will walk you through the differences between Amazon SQS Standard and FIFO queues, demonstrating various functionalities with practical Python examples. Each example will be in its own file, with clear instructions on how to run and what to expect. Repo for Code Reference aws/sqs/normal-fifo-queue-examples https://github.com/ankit630/unixcloudfusion-devops-solutions.git https://gitlab.com/ankit630/unixcloudfusion-devops-solutions.git Prerequisites An AWS account with appropriate permissions to create and manage SQS queues. Python 3.6 or later installed on your system. AWS CLI configured with your credentials. Boto3 library installed ( pip install boto3 ). Table of Contents Setting Up Your Environment Creating Standard and FIFO Queues Sending and Receiving Messages Visibility Timeout Message Deduplication and Grouping Dead-Letter Queues Long Polling Cleanup Setting Up Your Environment Create a new directory for this project and navigate into it: mkdi...