How to transfer Slack data to S3 using AWS appflow, query using athena and visualise in quicksight
8 min readFeb 16, 2021
Introduction to AWS Appflow, Athena and Quicksight
- Amazon AppFlow is a fully managed no-code integration service that helps to transfer data between Software-as-a-Service (SaaS) applications like Salesforce, Marketo, Slack, and ServiceNow, and AWS services like Amazon S3 and Amazon Redshift, in just a few clicks.
- Amazon Athena is a serverless, interactive query service to query data and analyzes big data in Amazon S3 using standard SQL.
- Amazon Quicksight is an AWS dashboarding service. It has a user-friendly drag and drop interface to create charts and full dashboards in less than an hour.
Architecture
In this blog post, we will be integrating Slack with Amazon Appflow and transferring data from Slack to Amazon S3. Then we will create Amazon Athena table and query the slack data using SQL. In the end, we will be creating charts in Amazon Quicksight using Amazon Athena as a source for the dataset.
In Amazon Quicksight we will be analysing messages that are posted to Slack #general channel. We will mockup messages so that the messages will look like CI/CD pipeline deployment notifications.