Duplicate Imports in Google Sheets

I am using the Perplexity module to find an article, and then I’m importing the url to a column in a Google Sheet. How can I have the scenario check the new url against the existing urls to insure it’s not a duplicate, keep looping back until it finds one that is not a duplicate, and then have the scenario continue on its merry way?

Assuming you get the URL as one bundle and no data strucuturing needs to be done.

All you need to do is:

  1. Google sheets search module.
    Does the URL exist in this sheet is what the condition is. If it does it will return the row if not it will return nothing found

  2. We add a filter only to add a row when nothing found.

  3. After the filter add you data in using the add a row module.

Thanks for your reply. I tried to run it with the new settings, but it doesn’t put anything into the Google Sheet. I’m including screen shots. Please let me know where I went wrong.

Can you send the output of find article please:

send over output bundles to help identify the issue here

In what you sent me also it doesn’t look like anything went wrong.

The searching found the url you were trying to input in row 3 which is why it didn’t add a row.

But sending the output of your module will help me more :slight_smile:

Here is the output bundle from the Perplexity Module that finds the article:

“id”: “c4d8100e-f609-4676-a03e-fadff8ab2d80”,
“model”: “llama-3-sonar-small-32k-online”,
“created”: 1720034832,
“usage”: {
“prompt_tokens”: 108,
“completion_tokens”: 16,
“total_tokens”: 124
“object”: “chat.completion”,
“choices”: [
“index”: 0,
“finish_reason”: “stop”,
“message”: {
“role”: “assistant”,
“content”: “Integrating Artificial Intelligence Into Radiation Oncology: Can Humans Spot AI? - PMC
“delta”: {
“role”: “assistant”,
“content”: “”

Ran it again to give you this:

But did you check to see if that URL is in the google sheet. @kslitton

You sent me this which shows it was working correctly since it found the URL in the google sheet it did not add a row. Where is this not working?

Ok, I see, but I need it to automatically loop back and continue looking until it finds an article so that eventually a url does appear in the Google Sheet on every run.

And no, there was no new url in the Google Sheet.

I just ran it about ten times, but it produced only two new urls in the Google Sheet, but I’d like to have it loop back automatically.