Iterator confusion: Scrape three websites from RSS feed, then summarise all content into document via OPenAI call. Possible?

Hi all,

I think I’m missing something fundamental here, but can’t seem to find an answer.

In my Automation I want to pull (say) 3 URL’s from the RSS feed, pass them to be scraped, then pass ALL the scraped content into a ChatGTP completion asking it to summarise the key points from ALL 3 articles.

However, this doesn’t seem possible. The iterator passes them one at a time into the webscaper and passes it to Chat GTP - meaning I’ll only get the a summary of ONE scraped website at a time.

I’ve looked at attaching an aggregator after the iterator, but got completely lost as to what that’s actually doing - and it all seemed to pass strange data into chat GTP.

Then I’m wondering why do I need an ‘iterator’?

What Make seems to lack (as far as I can see) is the ability to run some stuff and THEN move on to the next part of an automation within the same scenario - I even PAID someone to look into how this could be done, but they also drew a blank.

This seems like it should be easy, but I’m unable to do it, and a paid consultant couldn’t do it either, so I’m sort of now at the end of my journey with this. Does anyone have any suggestions I should be trying, or letting me know what I’m missing?

If I’m honest - my original intention was to get the automation to write summaries of each individual article as individual Google docs, and THEN write a summary document of ALL the articles - so I’m guessing if this is possible it would be done with a router and two simultaneous sets of operations occurring(?) - but I’ve stripped (for now) my scenario back to just this simple ‘summarise 3 articles from all this scaped text’ one.

I was going to try TWO separate scenarios (one to do the individual article summaries, and then another which goes and gets the outputs from those and summarises them, but this seems so convoluted that I can’t believe it can’t be done in a single scenario).

Any tips? Help always appreciated - I’m completely stuck on this and can’t get past it.

Welcome to the Make community!

Yes, that is possible. You’ll need a minimum of seven modules:

Give it a go and let us know if you have any issues!

Every result (item/record) from a list module will output a bundle. To “combine” them into a single structure, you’ll need to use an aggregator of some sort.

Aggregators are modules that accumulate multiple bundles into one single bundle. An example of a commonly-used aggregator module is the Array aggregator module. The next popular aggregator is the Text Aggregator which is very flexible and has applies to many use-cases.

There are other types of aggregator modules, click the below links to find out more:

If you need further assistance,

samliewrequest private consultation

Join the Make Fans Discord server to chat with other makers!

Cheers Sam, I’m afraid that doesn’t work - it immediately writes the final google doc based on the first piece of text its gets from the Scraptio (and subsequently starts creating new ones as each piece of text is passed to it). To reiterate - I want the final google doc to be a summary of ALL the data passed into the automation from the Scaptio module. I just don’t think Make.com is capable of doing this(?). I’ve tried adding filters and routers, I’ve paid someone, but nothing I do seems to work.

I’ve attached my blueprint if you’re interested - maybe I’ve missed something fundamental? Any assistance you could give would be very welcome - not sure what else I can do!
blueprint-scrap.json (41.7 KB)

You are probably using the Text Aggregator incorrectly then, because the way I’ve set it up, the “loop” is closed correctly (see the shaded part behind the first 5 modules?)

So it will complete all the runs from the first 5 modules, then only run the last two modules once.

Please do the Make Academy as aggregators are covered extensively there.

samliewrequest private consultation

Join the unofficial Make Discord server to chat with us!

Hi @Jayson_Freshton

Please check the loom video here

Regards,
Msquare Automation - Gold Partner of Make

Book a Free Consultation | Connect Live

Explore our YouTube Channel for valuable insights and updates!

You guys are the best! I’ve broadly got what I needed (not quite sure how it worked - but it does :-))

Thank you so much for the responses, and Msquare - for the really helpful video - taking time out of your day to record that is really appreciated. I’m back up and moving again now. Enjoy your week, and again thanks.

2 Likes

No problem, glad I could help!

1. If anyone has a new question in the future, please start a new thread. This makes it easier for others with the same problem to search for the answers to specific questions, and you are more likely to receive help since newer questions are monitored closely.

2. The Make Community guidelines encourages users to try to mark helpful replies as solutions to help keep the Community organized.

This marks the topic as solved, so that:

  • others can save time when catching up with the latest activity here, and
  • allows others to quickly jump to the solution if they come across the same problem

To do this, simply click the checkbox at the bottom of the post that answers your question:
Screenshot_2023-10-04_161049

3. Don’t forget to like and bookmark this topic so you can get back to it easily in future!

4. Do join the unofficial Make Discord server for live chat and video assistance

samliewrequest private consultation

Join the Make Fans Discord server to chat with other makers!

1 Like