Скрейпінг—це дуже зручно, просто треба спробувати.
Посилання
- База Xpath і взагалі зручний сайт
- https://www.youtube.com/watch?v=BHAS1UW1T1k
- https://github.com/yunshuipiao/zhihu-scrapy-spider GitHub - yunshuipiao/zhihu-scrapy-spider: scrapy + selenium + dynamic spider + all-powerful login
- https://github.com/cytopia/crawlpy GitHub - cytopia/crawlpy: Scrapy python crawler/spider with post/get login (handles CSRF), variable level of recursions and optionally save to disk
- https://github.com/divishram/Scrapy-download-rename-files GitHub - divishram/Scrapy-download-rename-files: Download any files with Scrapy and rename the files using one of the fields of your XPath selector
- https://datawookie.dev/blog/2021/06/scrapy-rotating-tor-proxy/
- https://pkmishra.dev/blog/2013/03/18/how-to-run-scrapy-with-TOR-and-multiple-browser-agents-part-1-mac/
- https://moodle.org/mod/forum/discuss.php?d=275986
- https://jarroba.com/anonymous-scraping-by-tor-network/
- https://www.geeksforgeeks.org/automated-brute-forcing-web-based-login/
- https://www.matthewthom.as/blog/stop-email-scraping/