On October 18th 2019, QASR hosted a web scraping workshop using python’s selenium package, led by QMSS student Yi Yin. It was an interactive workshop where we scraped from the web together. Not many students had web scraping experience, so step-by-step guides and pre-written codes made it easier and more approachable. Web scraping was done on two different websites. For the first, we worked on extracting information from a static page. For the other, Yi guided us on how to automate the whole process from loading the page, searching on the website for the information you want, clicking, extracting different types of information, finally putting the information to an organized table, and even downloading all the related data files! Thank you again Yi for teaching us beautiful automatization.
Information and files used for the workshop can be found in Yi’s github site.