Web Screenshot Automation
Implemented Python-based web scraping with Selenium, reducing data collection time from 500 minutes to less than 10 minutes for 500+ websites.
Tech Stack
- Python
- Selenium
Motivation
While working as a web developer at UBC, I encountered a practical problem: four research assistants were spending an enormous amount of time manually visiting and capturing screenshots of over 500 websites. This task, assigned by my manager who's also a professor, was crucial for their research but inefficient and tedious. Seeing their struggle, I realized I could make a difference. Using my skills in Python and Selenium, I decided to develop an automated web scraping tool. This wasn't just about coding; it was about finding a smart solution to a real-world problem and freeing up valuable time for the research team to focus on more critical tasks.