Trying to add a filter/module to this blueprint

I pulled this blueprint off this video, https://www.youtube.com/watch?v=5Wi7fqJwh6s&t=938s.

Ive attempted adding a filter, prevent duplicate files, but im missing something, I read a few posts of people attempting similar things but i cant figure out the best way to do it, ive attempted with aggregators or google search rows, im still failing to prevent dupes from getting into the spreadsheet,

The flow goes Run Scraper(apify) > get dataset(apify) —Filter dataset to meet requirements— > Reason with GPT if data is what im looking for > put into sheets. Ive attempted adding an aggregator scenario before the GPT as to prevent wasting tokens with GPT, to be cost effcient as possible, but it just wont fire correctly, I have a feeling im using the wrong filter paramaters with google sheets or the arrays, but even after attempting to use the array paramaters in the filter something is off and I cant fiture it out, does anyone have suggestions ?

1 Like

Hi @Westifer

Can you share you current filter setup, so that we further assist you.

Best regards,
Msquare Automation
Platinum Partner of Make
@Msquare_Automation

2 Likes

Welcome to the Make community!

To prevent duplicates, first you need to know what the sheet contains.

To do this, you can try using the Google Sheets “Search Rows” module —

Returns results matching the given criteria.

Limit the “result” to 1. Then filter when there are 0 results, which allows the scenario to proceed and Add a Row.

For more information, see https://www.make.com/en/integrations/google-sheets, and https://www.make.com/en/help/app/google-sheets in the help centre.

Hope this helps! Let me know if there are any further questions or issues.

@samliew

P.S.: Investing some effort into the Make Academy will save you lots of time and frustration using Make.

figured it out thanks

1 Like

Hi @Westifer

Glad to know you could figure out the issue yourself. You share how you solve the issue, This will keep the community healthy and organized. Also it will be helpful to for someone whou is facing the same issue.

Best regards,
Msquare Automation
Platinum Partner of Make
@Msquare_Automation

3 Likes