Modern Web Scraping with Python using Scrapy Splash Selenium

share ›
‹ links

Below are the top discussions from Reddit that mention this online Udemy course.

Become an expert in web scraping and web crawling using Python 3, Scrapy, Splash and Selenium 2nd EDITION (2021)

Reddemy may receive an affiliate commission if you enroll in a paid course after using these buttons to visit Udemy. Thank you for using these buttons to support Reddemy.

Taught by
Ahmed Rafik

Reddit Posts and Comments

0 posts • 9 mentions • top 6 shown below

r/Python • comment
2 points • PM_ME_BOOTY_PICS_

https://www.udemy.com/course/web-scraping-in-python-using-scrapy-and-splash/

I used this course to build a scraper. It scrapes my works website to get item specs then stores in an Excel file.

I recommend this course highly. It actually digs deeper than the general basics that most courses only go over.

Go to Reddit comment
r/learnpython • comment
1 points • Theendangeredmoose

I can say from past experience (100 + retail scrapers written that retrieve info for every single product on a site) that the above comment is absolutely true. For a small scraper, Selenium is fine. If you're scraping anything more than a couple hundred pages, you should never be using Selenium. In over 99% of cases, what you're doing with Selenium can be successfully emulated with requests alone.

You'll need to open chrome devtools, go to the Network tab, click 'x' button on the webpage, and watch for the AJAX call. Copy and paste this request along with the headers, and 99% of the time you can get the info required without selenium. This is absolutely necessary if you need to scrape at scale. For further information, I'd suggest this video:

https://youtu.be/6gtHzj4GMLo

If you really want a deep dive into scraping, I'd recommend this course ( I have no affiliation with the provider, I just did it myself and it was fantastic):

https://www.udemy.com/course/web-scraping-in-python-using-scrapy-and-splash/

Go to Reddit comment
r/webscraping • comment
3 points • rbalazsi

Depending on the format you prefer, here are a few good resources:

Go to Reddit comment
r/learnpython • comment
1 points • thakurbhanu_vipul

You can also use scrapy ( web scraper ) for this task. I used scrapy crawler for scraping data from this same website. You can learn from YouTube or from udemy course found here.

If you don't want to pay Udemy charges, get the course torrent from here.

The course is very well taught for beginners

Go to Reddit comment
r/scrapy • comment
1 points • dzirt07

just buy this course and join facebook group, write your code and if you have problem ask internet
https://www.udemy.com/course/web-scraping-in-python-using-scrapy-and-splash

Go to Reddit comment
r/scrapy • comment
1 points • Shashwatpuri

Looking all of your queries and replies,

seems like you need to go through a structured content.

Check this webscraping course out,

I'm enrolled in it already, useful stuff :

https://www.udemy.com/course/web-scraping-in-python-using-scrapy-and-splash/

Go to Reddit comment