Web scraping Animal Crossing data using Puppeteer

Опубликовано: 03 Ноябрь 2024
на канале: Read Write Exercise
143
2

Walkthrough of how to use headless browser Puppeteer to scrape website data for Animal Crossing data.

Check out the follow-up to this video where Jack builds a UI for the data I pull in this script:    • Tech A Day #28 - Vue  

===============
Code Link
===============
https://github.com/bradydowling/anima...

This video is a collaboration with Blue Collar Coder, Jack Herrington (   / jherr2006  , and was inspired by his family playing Animal Crossing and wanting a quick way of getting info about the animals in the game (I've know nothing about it).

Web scraping (or crawling) is a great way to get data that is not available via an API or CLI of some sort. In this video, I walk through my process of pulling data from an Animal Crossing website. Once I pull it down, I sent it over to Jack so he could put it together into a searchable UI.

This is the first time I used Puppeteer. I normally use Cheerio for web scraping so this ended up being my longest video to date with the most time spent editing.