University Scraper (UniSC)
Project Overview:
This Python-based scraper collects and structures undergraduate program information from the University of the Sunshine Coast (UniSC). The project automates the download of all program web pages, then parses each one to extract key admission details, saving them into a clean, analysis-ready CSV file.
Technologies Used:
- Python
- BeautifulSoup (HTML parsing)
- Pandas (Data storage and CSV export)
- urllib, os, ssl, time
Key Features:
- Automatically downloads all UniSC undergraduate program pages
- Extracts ATAR, QTAC codes, duration, fees, career outcomes, and more
- Handles dynamic and inconsistent HTML structures with fallback parsing
- Stores data as a structured CSV for educational analysis or dashboards
- Includes delay handling and SSL verification bypass for reliable scraping