Build a Serverless Twitter Dashboard using DynamoDB, APIGW and Highcharts

TL;DR HighCharts -> APIGW -> DynamoDB + Lambda function 🎉 cockpit.zoph.io (now offline) Introduction Lately, I was working on a new version, API based, for my Twitter Cockpit. In the previous version, Highcharts was loading data from some flat csv files. The goal of this cockpit is to retrieve and store unlimited history for specific Twitter accounts based on a Twitter list. It means that you can control from Twitter which accounts you want to graph for follower/following history. When you are using Twitter Analytics, the history only compares followers (not following) to the previous 28-day period, and the graph is in fact a non-clickable thumbnail image, a very poor experience for free users. ...

October 18, 2020 · 4 min · 646 words · Victor Grenu

Automate your SQL & NoSQL databases with AWS Managed Services

Disclaimer: This article was written with my co-author: Sandro aka Khrarec. thx dude. Introduction With the rise of cloud managed services comes a very important one: the databases. So, what’s a managed database service? Basically, a database is a server-side software like MySQL, MariaDB, PostgreSQL, or for NoSQL, Redis, MongoDB, etc. But when you install and build your database server that way, it means you have to manage the configuration, which is sometimes very tricky. You might make some mistakes that can kill performance. ...

September 15, 2019 · 11 min · 2157 words · Victor Grenu

SecretManagement for Terraform and Ansible

In this quick article, I’ll show you how I use AWS SSM Parameter Store as glue between Terraform and Ansible. Use Case For a personal project, I needed to pass some parameters (key/value) and secrets (encrypted) from my IaC Terraform to Ansible. AWS SSM PS? AWS SSM Parameter Store is a secure key-value store, a native EC2 functionality. From AWS Documentation: Parameter Store offers the following benefits and features: Use a secure, scalable, hosted secrets management service (No servers to manage). Improve your security posture by separating your data from your code. Store configuration data and secure strings in hierarchies and track versions. Control and audit access at granular levels. Configure change notifications and trigger automated actions. Tag parameters individually, and then secure access from different levels, including operational, parameter, EC2 tag, or path levels. Reference AWS Secrets Manager secrets by using Parameter Store parameters. Use Parameter Store parameters with other Systems Manager capabilities and AWS services to retrieve secrets and configuration data from a central store. The following AWS services support Parameter Store parameters: Amazon EC2, Amazon Elastic Container Service, AWS Lambda, AWS CloudFormation, AWS CodeBuild, and AWS CodeDeploy. Configure integration with AWS KMS, Amazon SNS, Amazon CloudWatch, and AWS CloudTrail for encryption, notification, monitoring, and audit capabilities. Terraform Set SSM secrets the right way: ...

October 5, 2018 · 2 min · 344 words · Victor Grenu

Using Athena & QuickSight for ALB-ELB Access Logs Analysis

In this article, I will describe how to use Athena and QuickSight to do BI/DataViz on your current Load Balancer Access Logs on AWS: ELB and ALB. From AWS: “Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run.” In a few minutes, you will be able to query your access logs, even if you have a huge amount of logs, with this serverless service. I will show you how to use the AWS DataViz product called QuickSight to get some great visuals. ...

February 18, 2018 · 4 min · 687 words · Victor Grenu