How to remove variables containing the same values

What are you trying to achieve?

I would like to remove duplicates from multi variables result.

Steps taken so far

As you can see at print screen, I have multi variables and some of them contains the same value (the same url). I would like to remove variables which contains the same url. Could you tell me which module I should use and how I can do it?

Screenshots: scenario setup, module configuration, errors

1 Like

Hi @Kon_O
as you are using text aggregator you can combine all of them separated by comma in a settings
and then create array and use deduplicate function and you will have a unique value

image

Thank you @CodexSolutions for your reply. I tried it that way you propose but it doesn’t work (or I made something wrong).

In result I get the same results as in previous case (the same url’s are not removed - still there are visible)

1 Like

Hi @Kon_O
You are currently receiving outputs in different operations, and the duplicates you are specifying are also different operations output. Change your source and set it to the main source of data.

Best regards,

Msquare Automation
Gold Partner of Make
@Msquare_Automation

Thank ou @Msquare_Automation for your reply. I tried but something is wrong. My goal is to parse page, take images urls from that page which match my reggex pattern and save that url on my google sheet.

Steps that I made:

I have html code of the page. I have correct regex pattern. I am using this regex pattern in “Match Pattern” module. In result I have a lot of url’s of images and some of them are the same so I would like to remove duplicates. And after thath I would like to save urls to my google sheet.

Right now I have problem with duplicates. After parsing html code I get in result a lot of URL’s which are the same and I don’t know how to remove duplicates. Could you give me example of module usage how can I do it? Thank ou in advance.

1 Like

Could anyone help me in this case? I will appreciate that :slight_smile:

1 Like

Hi @Kon_O
Have you done the step 3 and 4 in show advance setting of text aggregator. If you could share the output bundle of text aggregator, we can assist you further.


Best regards,

Msquare Automation
Gold Partner of Make
@Msquare_Automation