Social Icons

Tuesday, March 3, 2020

Web Scraping in Python with BeautifulSoup

 1 - What is beautifulSoup ? 

BeautifulSoup is a python library that lets you extract informations from a website, or from an XML document, with a few lines of code.

2 - How to intall BeatifulSoup ? 


Installing beautifulsoup is a fairly simple operation, just use the pip command line utility and type:
pip install beautifulsoup4

Installing beautifulsoup is a fairly simple operation, just use the pip command line utility and type: You must install from the command line via the pip utility, other important modules which are required for the proper functioning of beatifulsoup:

Install the lxml module:

pip install lxml

Install the html5lib module:

pip install html5lib

3 -Example of using beautifulsoup to extract information from web site 

We will see as an example how to retrieve the contents of all the h2 tags from a given url address.
import requests
from bs4 import BeautifulSoup

req = requests.get('https://www.my-courses.net/2020/02/the-python-numpy-library.html')
soup = BeautifulSoup(req.text, "lxml")
for h2_tag in soup.find_all('h2'):
    print(h2_tag.text)
The output is:
Social Icons
Pages
Monday, February 24, 2020

 1.  About numpy

2. Matrix or table with numpy

3.  The sublibrary linear algebra
Category Of Mobile Courses
Python Courses
Python For Data Science
Python-Exercises-with-solutions
Facebook Followers
Computer and internet Glossary
Follow by Email
HTML Courses
Javascript
Node.JS Courses
Followers
Total Views
Blog Archive
Contact me
My Courses

Blog Archive
Sample text
Sample Text 

Note 

With beautiful souple you can extract any tag content from web site

Example to extract content of all bold tag 'b'

import requests
from bs4 import BeautifulSoup

req = requests.get('https://www.my-courses.net/2020/02/the-python-numpy-library.html')
soup = BeautifulSoup(req.text, "lxml")
for bold_tag in soup.find_all('b'):
    print(bold_tag.text)

The output is:
Official documentation
numpy.linspace()
linear algebra

Younes Derfoufimy-courses.net

Note 

The beatifulsoup library has several other applications. For more information see the official website:
https://www.crummy.com/software/BeautifulSoup/

Younes Derfoufi
my-courses.net

No comments:

Post a Comment

Category Of Mobile Courses

Actualités (644) Adsense (1) Affiliation (1) Algebraic Topology (1) Algorithmic (1) all-news (30) Android (5) Android App (8) Android app without code (4) Android Apps (168) Android Development (4) Android download (2) Android OS (3) AngularJS (1) Automata theory and formal language (5) C programming (5) Category and Functor (8) CMS (3) Computer Glossary (18) Create Mobile App With Ionic Framework (2) CSS (2) CSS-Cascading-Style-Sheets (4) Developpement Java (13) Differential Geometry (1) Django-Python-Framework (8) dropshiping (26) Earn Money by Internet (4) Emplois (23) Framework php (2) Fraud (2) HTML (7) Java For Beginners (10) Javascript (12) Kotlin Programming Language (8) Kotlin For Mobile Android (1) Linux Download (2) Marketing (5) Mobile (3) Mobile Courses (4) Mobile Marketing (4) MoneyGram (1) News (721) Node.js (5) Open Source (1) Photoshop (1) Protect Computer (1) Python (33) Python BeautifulSoup (1) Python For Data Science (2) Python-Books (6) Python-DVD-Training (1) Python-Exercises (138) Python-Framework (1) Python-IDE (1) Python-Modules (1) Python-pdf (2) Python-pyQt (1) Référencement (2) Script PHP (2) Security (6) SEO (1) Snipping Tool: Faq (1) Social Networks (1) Source Code (1) Statistics With SPSS (2) Surveillance Software (1) Travail à domicile (6) Tutoriels php en vidéos (2) Tutoriels-MySql (6) tutoriels-php (19) Utilitaires (1) VPS (1) Web Hosting (1) Webcam (1) Webmarketing (11) Western Union (1) Windows 10 (1) Windows 7 (4) Windows 7 Faq (2) Windows 8 (1) Windows Accessories (1) Windows Download (8) Windows Drivers (1) Windows Fonts (1) Windows Power Shell (2) Windows Registry (2) Windows Security (18) Windows Software (2) Windows Spyware (2) Windows utilities (3) Windows Virus (2) Windows Vista (3) Windows Wireless (1) Windows xp (1) Wordpress (1)
 

Sample text

Sample Text

 
Blogger Templates