Kubernetes Cron Job vs. AWS Glue

As I’ve been dealing with streaming data one of the architectural decisions I’ve had to make is how to run periodic batch jobs on the data as it comes in.  In the case of web traffic, it is logged into a database.  What my batch jobs do is take the data from the MariaDB MySQL […]

Golang: AWS SDK, Cognito and API Gateway

The situation is as follows: Create an application with the serverless framework.  This uses API Gateway, Lambda, and all kinds of cool stuff. Authenticate on the application using Cognito. Write a client that can call the API created by API gateway in Go. Steps 1-2 are covered everywhere on the internet.  My favorite reference is […]

Ingress on AWS

While looking for different options on how to run an ingress controller on AWS I found that EKS recently announced support for an open source project that creates an ALB ingress controller.  One of the advantages of an ingress rule is that I can have many services be reachable via one external load balancer.  In […]

Serverless Computing: How did we get to now?

This is a story of the state of where we are in the world of containers, serverless, and whatever else you want to call this mess. The story involves 3 groups of people with their own passions, opinions, and modes of getting stuff done.  We’re getting to a point where they are no starting to […]

AWS Re:Invent 2015

AWS was an amazing conference.  All of my notes of the events I went to are here. (Scroll down to read the README.md file) Just some quick overall thoughts: 1.  Compared to Cisco, AWS really skips out on the food and entertainment.  I mean, come on, we had Aerosmith at Cisco Live and AWS gives […]

Getting Started with AWS EMR

AWS Elastic Map Reduce (EMR) is basically a front end to an army of large EC2 instances running hadoop.  The idea is that it gets its data from S3 buckets, runs the jobs, and then stores it back in S3 buckets.  I skimmed through a book on doing it, but didn’t get much out of […]

Ansible: From OSX to AWS

My goal in this post is to go from 0 to Ansible installed on my Mac and then be able to provision AWS instances ready to run Docker containers.  The code for this post is public on my github account. OSX Setup I am running OS X Yosemite.  I use brew to make things easy. […]

Remove an EC2 host with Ansible

I spent forever trying to understand the built in Ansible ec2 modules.  What I was trying to figure out seemed simple:  How do you delete all your ec2 instances?  Nothing too clever.  Turns out it was easier to create the instances than delete it (for me anyway).  So I’m writing this down here so I […]

Why Docker Changes everything

There are many shifts we talk about in IT.  Here are 2 recent examples come to mind that most people are familiar with: The shift from physical to virtual The shift from on-prem infrastructure to cloud based consumption IT. Ultimately it is an organization with a clear vision that disrupts the status quo and creates […]


I’m finally jumping in on the Docker bandwagon and it is pretty exciting.  Here’s how I did a quick trial of it to make it work. Install OS I could do this in my AWS account, or I can do it with my local private cloud.  So many options these days.  I installed the latest […]