How to load web page using Beautiful Soup
This recipe helps you to load a web page with the help of the request module and returns the HTML code of that web page.
Recipe Objective - How to load a web page using beautiful soup?
We will use the "requests" library to grant permission.
"requests" library enables us to send HTTP/1.1 requests.
With the help of the "bs4" library, we will be able to scrap the data from HTML and XML files.
request module:-
The "requests" module allows us to send HTTP requests using Python.
The HTTP request returns a response object with all the response data (content, data, etc.).
Table of Contents
For more related projects:-
https://www.projectpro.io/projects/data-science-projects/data-science-projects-in-python
https://www.projectpro.io/projects/data-science-projects/machine-learning-projects-in-python
Loading the web page:-
import requests
from bs4 import BeautifulSoup as bs
# load the projectpro webpage content
r = requests.get('https://www.projectpro.io/')
# convert to beautiful soup
soup = bs(r.content)
# printing our web page
print(soup.prettify())
What Users are saying..
Savvy Sahai
As a student looking to break into the field of data engineering and data science, one can get really confused as to which path to take. Very few ways to do it are Google, YouTube, etc. I was one of... Read More