Home » AWS
Creating a bot to automatically check for Amazon Flex delivery slots
Creating a bot to check for Amazon Flex delivery slots automatically requires a combination of web scraping techniques, user authentication, and scheduling mechanisms. Here’s a general overview of the process: Sample script Here is an example of a…
Read More »Quotas and Limitations of Various Managed Kafaka Services
This post contains a comparison of different managed Kafka-enabled message/event processing services available for AWS, Azure and Google Cloud Platform (GCP). I know I need to format this a bit better. Description Azure Event Hub Azure Event Hub…
Read More »Automate, Schedule and Deploy AMI backups of EBS-Backed EC2 Instances using Lambda, CloudWatch and Terraform
Last week a friend asked for a solution to automatically take backups of their EBS-Backed EC2 instances on AWS. The EC2 instances included a mix of Linux and Windows AMIs.This solution uses an AWS Lambda function written in…
Read More »Analysing UK House Price Data with Spark, Athena and Tableau
A few days back I joined a webinar by the latest Tabelau Iron Viz champion, Tristan Guillevin. Tristan created a dashboard to analyze US housing market using a summarized data set. I decided to replicate it using UK…
Read More »How to Sign HTTP Requests to AWS Data Lake Solution using Python
“AWS offers the data lake solution, which is an automated reference implementation that deploys a highly available, cost-effective data lake architecture on the AWS Cloud along with a user-friendly console for searching and requesting datasets.” (click here for…
Read More »AWS Lambda-backed Custom Resource to deploy tables in Athena via CloudFormation
You can use AWS::Athena::NamedQuery resource to create an Amazon Athena query. However there is no resource that can be used to create a database and table(s). This is where we can make use of Lambda-backed custom resources in a CloudFormation…
Read More »Setup AWS Lightsail with a Route 53 domain
A few days back I decided to revive my old blog hosted on webs.com. I had already transferred the management of my existing domain irtaza.info to Route 53. Initially I had a plan to create a serverless blog…
Read More »Troubleshoot Redshift / Paraccel COPY command load errors
The scripts below can be used on both Amazon Redshift and Actian Matrix (Paraccel) for operations related to COPY commands. Number of rows inserted by each succesful COPY command SELECT starttime, querytxt, lines_scanneD FROM stl_query NATURAL JOIN stl_load_commits…
Read More »
