New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Lesson 4: Scraping data #22

Open

Tracked by

e-belfer opened this issue Jan 31, 2025 · 0 comments

Open

Tracked by

Lesson 4: Scraping data #22

e-belfer opened this issue Jan 31, 2025 · 0 comments

Assignees

Member

e-belfer commented Jan 31, 2025 •

edited

Loading

Part 1: Pagination of EIA API

Part 2:
Iterate through the EIA 923 webpage and download all the spreadsheets. Use beautifulsoup to get every link on the page and filter.

Part 3:
Using: https://www.caiso.com/todays-outlook/supply and Inspect

GET https://www.caiso.com/outlook/current/fuelsource.csv
GET https://www.caiso.com/outlook/history/20250129/fuelsource.csv - iterate back through the last month and save files using date name.

e-belfer mentioned this issue

Epic: Prepare first two lessons for pilot workshop #3

Open

e-belfer assigned jdangerx

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment