IsaacShoebottom/KingsLandingJobScraper
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Add comments about improvments

Browse Source
This commit is contained in:
Isaac Shoebottom 2023-01-25 23:11:21 -04:00
parent 7f9cac6be8
commit ae9033ebff
1 changed files with 5 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
scraper.py
View File

@ -9,6 +9,11 @@ from bs4 import BeautifulSoup
# Made for a friend with love # Made for a friend with love
# Tested with Python 3.10.7 on Windows 10 # Tested with Python 3.10.7 on Windows 10
# TODO: Look into using requests, urllib3, and/or selenium to scrape the page
# https://pypi.org/project/selenium/
# https://pypi.org/project/urllib3/
# https://pypi.org/project/requests/
def scrape(): def scrape():
contents = urllib.request.urlopen("https://kingslanding.nb.ca/employment/").read() contents = urllib.request.urlopen("https://kingslanding.nb.ca/employment/").read()
soup = BeautifulSoup(contents, "html.parser") soup = BeautifulSoup(contents, "html.parser")