Web Scraping with Postman
Welcome to Web Scraping with Postman
This episode covers using web scraping to effectively extract data using cheerio.js and display it using Postman Visualizer, a powerful, built in, HTML, CSS, and Javascript renderer. With our sample site, remoteok.io, we can extract remote job posting information, and display it in Visualizer.
With the use of cheerio.js, you can scrape static html pages, and use the data for many things, such as monitoring (e-commerce, finance), data science, and even creating your own APIs!
Quick shoutout to Tristan Denyer for the use of Open Brewery DB Visualizer Template!
https://explore.postman.com/templates...
Watch How to Filter Data with Postman Visualizer
• How to Filter Data with Postman
Watch How to Visualize Data in Postman here!
• How to Visualize Data in Postman
Watch the first series, Introduction to Postman here!
• Introduction to Postman Tutorial
Watch the second series, Advanced Postman here!
• Advanced Postman
Download:
https://www.getpostman.com/downloads/
Web Scraping with Node JS (Level Up Coding)
https://levelup.gitconnected.com/web-...
Robots.txt Explanation
https://towardsdatascience.com/scrapi...
Postman Docs and Visualizer Examples:
https://learning.getpostman.com/docs/...
Postman Echo Docs:
https://docs.postman-echo.com/?versio...
More Resources:
Postman Documenter and Collection Export - Web Scraping with Visualizer
https://documenter.getpostman.com/vie...
https://explore.postman.com/templates...
https://explore.postman.com/team/470040
Handlebars.js Template Engine:
https://handlebarsjs.com
HTML Template:
https://gist.github.com/odevodyssey/8...
Questions about this episode or Postman? Ask in the comments!