Repeater Fails to Progress Beyond Second Batch in Data Retrieval Workflow

[Hendrik_Evens]

HI,

over the passed days i’ve been trying to create a scenario that sends my contacts from my crm system to mailchimp - however it only sends the first 50 contacts and can’t find the solution to move on to the next batch of 50 contacts:

Setup:

1. HTTP Module 1 retrieves the first 50 contacts.
2. Iterator 1 processes the first batch.
3. HTTP Module 2 fetches the next 50 contacts using the next-link.
4. Iterator 2 processes the second batch.
5. Repeater repeats HTTP Module 2 for subsequent batches until no more next-links are available.
6. Iterator 3 processes each new batch of 50 contacts.

---

Problem: The Repeater is stuck after the second batch. It keeps repeating the second batch of contacts instead of progressing to the third batch. The next-link isn’t properly passed for further iterations, causing the flow to stop at the second batch.

any ideas/suggestions to help?

thanks!

[samliew]

Welcome to the Make community!

You have not yet provided sufficient information to demonstrate the problem that would allow us to reproduce the scenario and any error(s).

To allow others to assist you with your scenario, please provide the following:

1. Relevant Screenshots

Could you please share screenshots of your full scenario? Also include screenshots of any error messages, module settings (fields), relevant filter settings (conditions), and module output bundles. We need to see what you’re working with to give you the best advice.

You can upload images here using the Upload icon in the text editor:

We would appreciate it if you could upload screenshots here instead of linking to them outside of the forum. This allows us to zoom in on the image when clicked, and prevent tracking cookies from third-party websites.

2. Scenario Blueprint

Please export the scenario blueprint. Providing your scenario blueprint file will allow others to quickly recreate and see how you have set up the mappings in each module, and also allows us take screenshots or provide module exports of any solutions we have for you in return - this would greatly benefit you in implementing our suggestions as you can simply paste module exports back into your scenario editor!

To export your scenario blueprint, click the three dots at the bottom of the editor then choose ‘Export Blueprint’.

You can upload the file here by clicking on this button:

3. Output Bundles of Modules

Please provide the output bundles of each of the relevant modules by running the scenario (you can also get this without re-running your scenario from the History tab).

Click on the white speech bubbles on the top-right of each module and select “Download input/output bundles”.

A. Upload as a Text File

Save each bundle contents in a plain text editor (without formatting) as a bundle.txt file.

You can upload the file here by clicking on this button:

B. Insert as Formatted Code Block

If you are unable to upload files on this forum, alternatively you can paste the formatted bundles.
These are the two ways to format text so that it won’t be modified by the forum:

• Method 1: Type code block manually

  Add three backticks ``` before and after the content/bundle, like this:

  ```
  <sup>content goes here</sup>
  ```

• Method 2. Highlight and click the format button in the editor

  

Providing the input/output bundles will allow others to replicate what is going on in the scenario, especially if there are complex data structures (nested arrays and collections) or if external services are involved, and help you with mapping the raw property names from collections.

Sharing these details will make it easier for others to assist you.

[Hendrik_Evens]

HI,

please find attached the screenshots of my scenario and the outputbundle from the first HTTP module. I found the “next” link in this outputbundle to the next set of 50 contacts, but i cannot find a way to loop the flow until all contacts are synced.

kind regards,
Hendrik

please let me know if you need any extra information
blueprint (2).json (30.6 KB)

~$tpunt bundle HTTP module 1.txt (162 Bytes)

[samliew]

In this case, you should take this unit in the Make Academy, specifically, “Pagination - total number of items unknown”.

For more information, see 🟣 Make Academy: Course Overview :

3. Course - Pagination - retrieving all data from APIs

• What is Pagination?
• Pagination - total number of items known
• Pagination - total number of items uknown
• Pagination - Offset
• Practice Pagination

Hope this helps! Let me know if there are any further questions or issues.

— @samliew

P.S.: Investing some effort into the Make Academy will save you lots of time and frustration using Make.

[Hendrik_Evens]

HI Sam,

thanks for the feedback - i’ve gone through the documentation but i’m still stuck how to start my scenario.

Am i correct to assume that i should start with an HTTP module to retrieve the “initial url” and continue with the set-up as shown in the acadame (initial url - repeater - get page url..)?

thanks for the clarification!