Recently, we have all seen many reports of AWS buckets that contained private data that were misconfigured and fully open to the public. Whether the result is slight embarrassment or a serious exfiltration of data, the risk of a misconfigured bucket can be mitigated fairly easily. Amazon S3 buckets can… Continue reading
So it happened. One of our techs ‘accidentally’ deleted all the directories and files in one of our S3 buckets. I enabled S3 Bucket Versioning on all our important buckets. So the deleted files are still there with the ‘latest version’ of the file being a Delete Marker. If you… Continue reading
In this example I want to open a file directly from an S3 bucket without having to download the file from S3 to the local file system. This is a way to stream the body of a file into a python variable, also known as a ‘Lazy Read’. import boto3… Continue reading
I was recently asked to create a report showing the total files within the top level folders and all the subdirs under the folder in our S3 Buckets. S3 bucket ‘files’ are objects that will return a key that contains the path where the object is stored within the bucket…. Continue reading
I’m writing this on 9/14/2016. I make note of the date because the request to get the size of an S3 Bucket may seem a very important bit of information but AWS does not have an easy method with which to collect that info. I fully expect them to add… Continue reading
I’m here adding some additional Python Boto3 examples, this time working with S3 Buckets. So to get started, lets create the S3 resource, client, and get a listing of our buckets. import boto3 s3 = boto3.resource(‘s3’) s3client = boto3.client(‘s3’) response = s3client.list_buckets() for bucket in response[“Buckets”]: print(bucket[‘Name’]) Here we create… Continue reading
Mike's Guides to Learning Boto3 Volume 1: Amazon AWS Connectivity and Basic VPC Networking
Mike's Guides to Learning Boto3 Volume 2: AWS S3 Storage: Buckets, Files, Management, and Security
Or Feel free to donate some beer money through paypal.
You have my Thanks.