Data Integration and APIs for Analysis Training Course

Share this course

Duration

2 Days

Course Overview

Analysts who pull figures from web services, databases and files learn over two days to bring those sources together and keep the data flowing on its own. Day one covers what integration means for analytics and its common problems, explains RESTful APIs, connects to them with Postman and Python, and extracts data from an open API. Day two cleans and reshapes that data, builds an ETL pipeline in Python or an ETL framework, then schedules, monitors and automates API calls and loading. Cases from finance, healthcare and e-commerce lead into a group task to design and present an integration workflow.

Format of Training

  • Trainer-led sessions that start in Postman and move into Python scripts
  • Hands-on pull from a public open API, then cleanup of the results
  • Demo of scheduled API calls feeding an analytics store
  • Group workflow design on a business case, shared with the room

Course Objectives

  1. Explain data integration and how API-based workflows run.
  2. Connect to APIs and pull structured and unstructured data.
  3. Work with Postman, Python and ETL frameworks.
  4. Automate data integration jobs.
  5. Build workflows that transform and join data from many sources.
  6. Apply sound practice to keep data accurate and consistent.
  7. Bring varied data sources into one analytical workflow.

Prerequisites

Course Outline

Day 1: Fundamentals of Data Integration and APIs

Session 1: Introduction to Data Integration

  • What data integration is and how it supports analytics
  • Common problems and good practice when joining varied sources

Session 2: Working with APIs

  • How RESTful APIs are put together
  • Calling APIs from Postman and from Python

Session 3: Extracting Data from APIs

  • Ways to pull data from structured and unstructured sources
  • Collecting data from an open API for analysis

Day 2: Advanced Integration Techniques and Automation

Session 1: Data Transformation and ETL Workflows

  • Cleaning, reshaping and preparing data for analysis
  • Building an ETL pipeline in Python or an ETL framework

Session 2: Automating Data Integration Processes

  • Scheduling and watching data workflows
  • Demo: automating API calls and data loading

Session 3: Real-World Applications and Best Practices

  • Cases from finance, healthcare and e-commerce
  • Group task: designing a data integration workflow for a business case and presenting it

Book This Course

Customise This Course for Your Team

If your analysts rely on particular APIs, such as a CRM, payment or web analytics service, the labs can call those in place of the open API. Teams already using an ETL framework can build the Day 2 pipeline in it. Share the sources you need to connect and we will plan the exercises around them.
Need help with the right course to choose?

Explore more opportunities

Introduction to Data Engineering Training Course

ETL Processes for Data Pipelines Training Course

Data Modeling for Analytics Training Course

Building Scalable Data Pipelines with Apache Airflow Training Course

Data Warehousing with Snowflake and Redshift Training Course

Real-Time Data Processing with Kafka Training Course

Data Integration and APIs for Analysis Training Course