Scrape Content from Redirected Google News Links

I’ve found a method, you have to use a hosted scraper like DumplingAI or ScrapeNinja.

Here is an example:

Screenshot_2024-08-30_150854

Example Output

Others

I’ve used ScrapeNinja, and you can use jQuery-like selectors in the extractor function. But this is more advanced. ScrapeNinja also can run the page in a real web-browser, loading all the content and running the page load scripts so it closely simulates what you see, as opposed to just the raw page HTML fetched from the HTTP module. If you want a ScrapeNinja example, take a look at Grab data from page and url - #5 by samliew

For more information on other different methods of web scraping, see Overview of Different Web Scraping Techniques in Make 🌐

Hope this helps! Let me know if there are any further questions or issues.

@samliew


P.S.: Did you know, the concepts of about 70% of questions asked on this forum are already covered in the Make Academy. Investing some effort into it will save you lots of time and frustration using Make later!