Creating an automation using webscrapers services via API

Hello everyone!
I’m working on a couple of automations that create summaries of web-news articles. I use:

  1. the RSS module that sends urls to
  2. Scrapeninja then to
  3. Text Parser (html to text) then I ask
  4. chatGPT to extract the very body of an article
  5. and to create a summary

My aim is to get rid of the steps 2, 3 and 4. I’am going to use a third party service that does the scraping, parsing and the extraction of the body of an article. The problem is that this service doesn’t have its module on make.com.

So I need help with modules choice. Which modules do i need for sending my url to this third party service via API and getting the processed data back?

Thank you

Welcome to the Make community!

Make doesn’t have an integration for your third-party service?

If the external service has a Developer API Reference/Documentation then you should be able to integrate the endpoints in Make using the generic HTTP “Make a request” module.

You can also suggest for it to be made in the Idea exchange. Don’t forget to search for it first, just in case someone already suggested it, so that you don’t end up creating a duplicate.

If you need assistance in setting up the generic HTTP module, please provide additional information about what you have tried with regards to the external service’s Developer API Reference – how you are setting the connection up, a link to the endpoint are you trying to connect to, and what errors you are encountering.

You can also complete this brand new course/tutorial in the Make Academy on how to use external APIs — API calls with HTTP modules

  • API and Endpoints
  • Header and body
  • Multipart/form-data
  • OAuth 2.0

Hope this helps! Let me know if there are any further questions or issues.

@samliew

P.S.: Investing some effort into the Make Academy will save you lots of time and frustration using Make.

Wow, haven’t seen this course. It seems to be the best option! Thanks a lot!