Hi,
I’m encountering a problem with the next_max_id in an Instagram API using an HTTP make request. I’m trying to scrape followers from 5 Instagram accounts, which have a total of about 14k followers. However, the scraping process only retrieves 25 followers per account each time.
Additionally, I have implemented a filter to avoid scraping duplicates, but every time I run the script, it starts from zero and scrapes the same followers again, wasting my monthly operations.
How can I scrape all followers without repeating the already scraped ones?
I’ve already scraped about 450 followers, but every time I run the script again, it takes around 300 operations to retrieve just 2 or 3 new records.
I’ve also tried t Master Pagination Techniques of API in Make (Formerly Integromat, but I’m having a hard time implementing it in my scenario. When I add it to my HTTP request, it doesn’t show the data pagination necessary to create the link for repetition.
