Compressing Python dictionary objects before storing in json S3 files.

Here’s a quick little script I wrote since I need to test uploading files into s3. In this case the file generated will be 78 bytes. When unzipped 170 Bytes. The reason I wrote this is because I have to upload large amounts of data in json form into S3. Saving space in S3 results…

Cloudfront S3 static site hosting and index.html

This article I followed was a little outdated.  Things do change a lot in 3 years.  It’s mostly the same as the function seems to work but the implementation does not.  Following the hints here I was able to get this to work.  The big one was you need to refresh your browser.  I think…

Kubernetes Cron Job vs. AWS Glue

As I’ve been dealing with streaming data one of the architectural decisions I’ve had to make is how to run periodic batch jobs on the data as it comes in.  In the case of web traffic, it is logged into a database.  What my batch jobs do is take the data from the MariaDB MySQL…