To receive a Zoom link after registering above, please fill out the affiliations form if you have not done so at least once before: https://dlab.berkeley.edu/affiliations
Trying to register, but not affiliated with the UCB campus? If you are from Berkeley Lab (LBL), UCSF, CZ Biohub, or other organizations, please register via our partner portals here.
Location: Remote via Zoom. Link will be sent on the morning of the event.
Recordings: This D-Lab workshop will be recorded and made available to UC Berkeley participants for a limited time. Your registration for the event indicates your consent to having any images, comments and chat messages included as part of the video recording materials that are made available.
Date & Time: This workshop runs from 2pm-4pm on:
• Thursday, November 2
Start Time: D-Lab workshops start 10 minutes after the scheduled start time (“Berkeley Time”). We will admit all participants from the waiting room at that time.
Description
In this workshop, we cover how to scrape data from the web using Python. Web scraping involves downloading a webpage's source code and sifting through the material to extract desired data.
Web scraping is typically only done when Web APIs are not available. Platforms like Twitter, Reddit, or The New York Times offer APIs to retrieve data. If you want to learn how to use web APIs in Python, see D-Lab's Python Web APIs workshop.
Requirements
We will assume a basic knowledge of Python. If you've taken the D-Lab's Python Intensive, that should be sufficient.
Prerequisites: D-Lab’s Python Fundamentals introductory series or equivalent knowledge.
GitHub Repository: https://github.com/dlab-berkeley/Python-Web-Scraping
Software Requirements:Installation Instructions for Python Anaconda
Is Python Not working on your laptop? Attend the workshop anyway, we can provide you with a cloud-based solution until you figure out the problems with your local installation.
Feedback: After completing the workshop, please provide us feedback using this form
Questions? Email: dlab-frontdesk@berkeley.edu