We have a couple of pods that get pretty intense memory use. It’s possible there is a memory leak because it OOM’d a node due to a spike in usage. One of our temporary solutions while we investigate is to put a pod anti-affinity rule in the deployment. What this means is that we don’t…
Category: Kubernetes
Kubernetes Cron Jobs vs. AWS Lambdas
I’ve always stressed that it should never be Kubernetes or Serverless, but rather: What is the right tool for the job. Both technologies are great and both technologies carry their own baggage. This week as I was working on some design and thought about its implementation I had to decide whether I should add a…
Kubernetes Ingress pass through to internal services (not on the Kubernetes cluster)
This is a pretty confusing title but the gist of it is this: We have a service, let’s suppose its a database, running internally. We can get to it from our Kubernetes cluster, but resources outside of Kubernetes can’t get to it. And the only way we can get to Kubernetes services is through a…
Prometheus Service Monitors
Prometheus is confusing. It’s such a great project and there is all kinds of information out there, but it’s taken me a bit of legwork to understand it. The first issue is: How are you going to install it? Since I’m running this on Kubernetes it makes sense to use whatever most people are doing….
Lens and EKS
Lens is a really cool front end dashboard for Kubernetes clusters. One issue I ran into from connecting to the cluster was that I typically use different AWS Profiles for different clusters. Typically I’ll do something like: To set my user. To put this in Lens so that it can connect, we just add this…
Allowing Applications in AWS EKS to access other AWS services
I have an application that runs in a container. The application is pretty simple in that all it does is list the contents of a DynamoDB database I created. The code is here, as well as all the YAML files for deploying to EKS. The problem is, when we pull this up on a standard…
Increasing Upload Sizes with the Nginx Ingress Controller Kubernetes for WordPress Sites
Previously I had installed wordpress pods on Kubernetes and it made it very easy to administer and add multiple sites for clients. However, as time went on they started getting more aggressive in the different themes they were uploading. To solve the problem required configuration changes in two places. The Ingress Controller The PHP file…
Kubernetes Cron Job vs. AWS Glue
As I’ve been dealing with streaming data one of the architectural decisions I’ve had to make is how to run periodic batch jobs on the data as it comes in. In the case of web traffic, it is logged into a database. What my batch jobs do is take the data from the MariaDB MySQL…
Ingress on AWS
While looking for different options on how to run an ingress controller on AWS I found that EKS recently announced support for an open source project that creates an ALB ingress controller. One of the advantages of an ingress rule is that I can have many services be reachable via one external load balancer. In…