Learn to Scrape Websites using PhantomJS and CasperJS - 1/6

Опубликовано: 12 Октябрь 2024
на канале: JsWiz
10,797
55

Full Course: https://goo.gl/QEo1ie

In this course you will learn how to scrape data from web pages using CasperJS.

This course consists of 5 example projects to help you fully understand the powers of CasperJS and the headless browser.


What to Expect

We'll begin with an overview of how both PhantomJS and CasperJS works along with how to install these frameworks. Next, we'll discuss what our workflow will look like and the options we can pass into a Casper object. Then we'll dive into the meat of this course by working through 5 projects.


The Projects Will Cover

How to scrape websites that are rendered with JavaScript instead of standard HTML

How to wait for AJAX loaded data to appear before scraping elements

How to submit forms both for Authorization and when making searches

How to define navigation Steps - like logging into a site, clicking a button and following links

How to write and save specified data in tables then output as an .html file or as JSON.

And how to take screenshots both of full web pages and specific containers


What You Will Learn

You will gain a thorough understanding of advanced web scraping concepts and also gain an insight into how to use the Casper API for Testing DOM manipulation and UI interaction.