Web Scraper -using Cheerio

This is a scraper made with nodejs, express with a simple line of code, it can scrape pretty much anything for a website by mentioning/passing the class.

Dev Note📐 Packages used

• Express

• Cheerio

• Axios

Express.js

npm i express // to install
// Import the Express library.

const express = require('express');

// Initializing the app.

const app = express();

// Getting the path request and sending the response with text

app.get('/', (req,res)=>{

    res.send('Hi, your request has been received')

})

// Listen on port 2000

app.listen(2000, ()=>{

    console.log('listening at https://localhost:2000')

})

Cheerio

Cheerio parses markup and provides an API for traversing/manipulating the resulting data structure. It does not interpret the result as a web browser does.

Axios

 Axios is a Javascript library used to make HTTP requests from node. js or XMLHttpRequests from the browser and it supports the Promise API that is native to JS ES6. It can be used intercept HTTP requests and responses and enables client-side protection against XSRF. It also has the ability to cancel requests.

Javascript Promise

The Promise object represents the eventual completion (or failure) of an asynchronous operation and its resulting value.

Each
.each() function can be used to iterate over any collection, whether it is an object or an array. In the case of an array, the callback is passed an array index and a corresponding array value each time.

This

It has different values depending on where it is used:

• In a method, this refers to the owner object.

• Alone, this refers to the global object.

• In a function, this refers to the global object.

• In a function, in strict mode, this is undefined.

• In an event, this refers to the element that received the event.

• Methods like call(), and apply() can refer to any object.

Find

The find() method returns the value of the first element that passes a test.

The find() method executes a function for each array element.

The find() method retuns undefined if no elements are found.

The find() method does not execute the function for empty elements.

The find() method does not change the original array.

Attr

The attr() method sets or returns attributes and values of the selected elements. When this method is used to return the attribute value, it returns the value of the FIRST matched element.

Push

The push() method adds new items to the end of an array.

The push() method changes the length of the array.

The push() method returns the new length.