NBA Player Database Webscraper

INFO:

• Scrapes from a NBA Player database website

• Webscraping using beautiful soup

• Exports in JSON, CSV and SQL

• Fetches content over multiple pages

• Uses multiple optimizations to reduce runtime and

• Reduced bandwidth resources

• Makes use of only one connection with the server per scrape

• Also provided as an module to make use of it as an object in an already existing code

MODULES:

• Requests

• Beautifulsoap

• lxml

BRIEF:

This web scraper uses bs4 along side with lxml (which is faster by 5x than the default html.parser), also makes uses a connection session (requests.session()) to prevent multiple connections and do multiple GET requests through that connection. This webscraper also exports in multiple file formats such as CSV, SQL, JSON allowing for a flexible usecases for the script. The script is also turned into a module which let's you access its functionality with more flexibility and freedom by letting you access it inside an already existing code or a fresh code as a python object

This was made as a proof of skill in the libraries mentioned, the code is meant to be light weight and efficient while showcasing its flexibilty in export. A portfolio project on webscraping using BeautifulSoup for Upwork

By yours truely,

-Amogha.Y.A