Here we are introducing data collection through APIs, one of the most common ways of getting data from the internet.

Knowing how to use APIs will be key for data profiling and performing exploratory data analysis (EDA).

Intro To Requests

Let’s open up the file(s) in the 01-Ins_RequestsIntro folder to get started.

This is a little more technical, and part of the data collection phase for data analysts, scientists and engineers.

The idea is to understand the concept, and how to use the APIs. The inner workings of how the APIs work isn’t important for this lesson.

Students Do: Requesting SpaceX

Let’s open up the file(s) in the 02-Stu_SpaceX-Request folder to get started.

Manipulating Responses

Let’s open up the file in the 03-Ins_ManipulatingResponses folder to get started.

Students Do: Requesting a Galaxy Far, Far Away

Let’s open up the file(s) in the 04-Stu_FarFarAway-APIData folder to get started.

Students Do: Number Facts – API Application

Let’s open up the file(s) in the 05-Par_NumberFacts-APIApplication folder to get started.

OMDb API

Let’s open up the file(s) in the 06-Ins_OMDbRequests to get started.

We will be using the OMDb API (https://www.omdbapi.com/) for the next few exercises.

Students Do: Study the OMDb API

Look at the file(s) in the 07-Stu_Explore_OMDb_API folder.

When we see a new API, we will do the following items:

  • Data Profiling through:
    • Exploratory Data Analysis (EDA)
    • Data Gap Analysis (DGA)

Students Do: Movie Questions

Let’s open up the file(s) in the 08-Stu_MovieQuestions to get started.

Iterative Requests

Let’s open up the file(s) in the 09-Ins_IterativeRequests to get started.

Students Do: Movie Iterative Requests

Let’s open up the file(s) in the 10-Stu_MovieLoop to get started.

NYT API

Let’s open up the file(s) in the 11-Ins_NYTAPI to get started.

Students Do: Retrieving Articles

Let’s open up the file(s) in the 12-Stu_RetrieveArticles to get started.