Recently, we have all seen many reports of AWS buckets that contained private data that were misconfigured and fully open to the public. Whether the result is slight embarrassment or a serious exfiltration of data, the risk of a misconfigured bucket can be mitigated fairly easily. Amazon S3 buckets can… Continue reading
What is ec2 pagination? AWS boto3 clients will only return 1000 entries max. That means if you have 1002 ec2 instances and use boto3 client to describe those instances what you get back is a list of 1000 EC2s, not the full 1002. This is the same for other clients… Continue reading
The Amazon Command Line (AWSCLI) is the tool from AWS that lets you interact with the AWS API. When using the AWSCLI you must pass it credentials like key/secret key or you can setup awscli config so that AWS can cache a single key/secret key to use with the commands. … Continue reading
8-5-2019 In Amazon AWS, this is a process you can use to increase the size of a EC2’s primary disk without having to reboot the host. Let’s assume you have an EC2 linux host and just increased the disk from 10 Gb to 20 Gb because you needed more space. … Continue reading
So it happened. One of our techs ‘accidentally’ deleted all the directories and files in one of our S3 buckets. I enabled S3 Bucket Versioning on all our important buckets. So the deleted files are still there with the ‘latest version’ of the file being a Delete Marker. If you… Continue reading
In this example I want to open a file directly from an S3 bucket without having to download the file from S3 to the local file system. This is a way to stream the body of a file into a python variable, also known as a ‘Lazy Read’. import boto3… Continue reading
Recently I was asked to scour multiple AWS accounts to find any users or host role that had the S3FullAccess policy applied. So I came up with the following that will go through all users and roles to identify the ones with the S3FullAccess policy assigned. You can use this… Continue reading
I was recently asked to update a single tag in all of our 800 hosts only if there was already another tag present. So I need to look at all hosts, if I find a tag called ‘Type’ that contains the text ‘copy-from’ or ‘copy-from’ is in the value at… Continue reading
AWS allows you to assume roles in other AWS accounts. Its a nice feature that allows you to log into 1 account, assume a role in another account, and issue API commands as if you had signed into the 2nd account. You can have all users sign into 1 central… Continue reading
This will walk you through setting up an Ipsec VPN between 2 networks using 2 hosts using strongswan to build the tunnel. This was my go to solution to connect Amazon AWS VPCs across regions… that is until AWS allowed peering VPCs across regions in December of 2018. So connecting… Continue reading
Mike's Guides to Learning Boto3 Volume 1: Amazon AWS Connectivity and Basic VPC Networking
Mike's Guides to Learning Boto3 Volume 2: AWS S3 Storage: Buckets, Files, Management, and Security
Or Feel free to donate some beer money through paypal.
You have my Thanks.