Scraping a news story

Questions
1

I am trying to automate the collection the content of news stories using Make.com. I have a google alert setup using an RSS feed. I have successfully been able to load each of the URLs generated by this alert - but I cannot get the contents of the body of the article. I have attempted many alternatives (ScrapeNinja, HTTP API Call, HTTP Get, etc.) What is the easiest way (fewest outside tools) to get the body of a news story like this one “https://www.google.com/url?rct=j&sa=t&url=https://broadbandbreakfast.com/join-the-resilient-digital-infrastructure-summit-on-september-18-2025/&ct=ga&cd=CAIyGmNiYzVjZTM4ZTFlYjk1ZWQ6Y29tOmVuOlVT&usg=AOvVaw2-SDBDN5FDoxV53VvYxwvz”

I have API subscriptions to ScrapeNinja, OpenAI and Perplexity. Thanks for you assistance.

2

Figured this out using Scraping Bee (ScrapeNinja - and its documentation - was not working for me). The essential piece of knowledge I uncovered is that many article authors use the HTML tag or to contain the “body text” of the article. My JSON extraction was simple {“title”:“title”,“body”:“body”,“article”,“article”}. After I get this object I then investigated bot and to select the larger item…and then cut this item down to 40,000 characters (because I wanted to store it in a single cell in a google sheet). Hope this helps someone someday!

1 Like