Scrape Article Content from Redirected Google News Links

Welcome to the Make community!

If you view the source code of the HTML file, it looks like a client-side JavaScript redirect. This means that the “Follow redirects” option in the HTTP module won’t work as that option is for server-side 301/2 redirect codes.

From the source code, there are three obvious URLs to the article, so you could probably use a Text Parser “Match Elements” module to extract the URLs, and then filter by the domain name.

Or, you can just aggregate the results and use the built-in function last to get the last URL on the page.

Screenshot_2024-04-23_210433

Give it a go and let us know if you have any issues!

samliewrequest private consultation

4 Likes