I would like to remove duplicates from multi variables result.
Steps taken so far
As you can see at print screen, I have multi variables and some of them contains the same value (the same url). I would like to remove variables which contains the same url. Could you tell me which module I should use and how I can do it?
Hi @Kon_O
as you are using text aggregator you can combine all of them separated by comma in a settings
and then create array and use deduplicate function and you will have a unique value
Hi @Kon_O
You are currently receiving outputs in different operations, and the duplicates you are specifying are also different operations output. Change your source and set it to the main source of data.
Thank ou @Msquare_Automation for your reply. I tried but something is wrong. My goal is to parse page, take images urls from that page which match my reggex pattern and save that url on my google sheet.
Steps that I made:
I have html code of the page. I have correct regex pattern. I am using this regex pattern in “Match Pattern” module. In result I have a lot of url’s of images and some of them are the same so I would like to remove duplicates. And after thath I would like to save urls to my google sheet.
Right now I have problem with duplicates. After parsing html code I get in result a lot of URL’s which are the same and I don’t know how to remove duplicates. Could you give me example of module usage how can I do it? Thank ou in advance.
Hi @Kon_O
Have you done the step 3 and 4 in show advance setting of text aggregator. If you could share the output bundle of text aggregator, we can assist you further.