I have successfully crawled dozens of Telegram messages using Apify. However, when updating this data in Google Sheets, only about 4–5 messages are actually being updated, while the rest are not.
I would like to understand the possible causes of this issue and how to resolve it. Could you please provide guidance on how to ensure that all crawled messages are properly updated in Google Sheets?
I have successfully crawled messages numbered 1 to 40, and I can confirm that all messages are properly retrieved. However, only a few of these messages are being updated in Google Sheets.
Are there any specific settings I should check to ensure that all crawled messages are updated correctly?
Every result (item/record) from trigger/iterator/list/search/match modules will output a bundle. This can result in multiple bundles, which then trigger multiple operations in future modules (one operation per bundle). To “combine” multiple bundles into a single variable, you’ll need to use an aggregator of some sort.
Aggregators are modules that accumulate multiple bundles into one single bundle. An example of a commonly-used aggregator module is the Array aggregator module. The next popular aggregator is the Text Aggregator which is very flexible and can apply to many use-cases like building of JSON, CSV, HTML.
You can find out more about the other types of aggregator modules here:
The Array Aggregator module is very powerful because it allows you to build a complex array of collections for a later module’s field to map multiple items (collections) to it.
This is done using the “Target structure type” field in an Array Aggregator module.
As you can see, the “Map” toggle on complex fields are used when you have an array. You can easily build an array variable to map to a future module’s field, by using an Array Aggregator module and select the “Target Structure Type” as the future module’s field you have mapped the array into.
Example
Here is an example of how your scenario could look:
This is just an example. Your final solution may or may not look like this depending on your requirements.
Hope this helps! Let me know if there are any further questions or issues.
