Hey guys,
So what i’m trying to do with this automation is scrape 5 different blogs, and add each to a different variable. When i check for variables, I’m only getting one bundle from Feedly. How can i scrape the other bundles as well and add them to a variable?
Welcome to the Make community!
From what I understand, you want to use the same bundles in a single operation?
Every result (item/record) from a search/match module will output a bundle. To “combine” them into a single structure, you’ll need to use an aggregator of some sort.
Aggregators are modules that accumulate multiple bundles into one single bundle. An example of a commonly-used aggregator module is the Array aggregator module.
samliew – request private consultation
Join the unofficial Make Discord server to chat with us!
So Feedly outputs 5 bundles, and in every bundle there is a link to an article. What I want to do is scrape every article and put each one of them in a separate variable.
But the automation is scraping only one bundle.
Please send a screenshot of your scrapio module. Lets see what you are mapping there for the link to the article.
You should use the outout from Feedly 27 not from where you are using it taking it from module 38 not sure what this is unless you send a full screenshot.
That is why you are not taking in from the 5 bundles you are scraping.
it’s a very long output of the bundles
That’s is ok. I Need it sent to help more.
[
{
“id”: “UGoT913Pj2iVsp570XrRhskqe5/o7yyV3N/NTloByRs=_190f3bb34c6:d52c7e:9b7668c4”,
“href”: “Scientists Use AI to Decode Sperm Whale Sounds, Find Phonetic Alphabet - Business Insider”,
“title”: “Scientists are closer than ever to deciphering the secret language of sperm whales. AI could be the key.”,
“author”: “elapointe@insider.com (Ellyn Lapointe)”,
“source”: {
“url”: “https://www.businessinsider.com”,
“title”: “Business Insider”,
“streamId”: “feed/Business Insider”
},
“visual”: {
“processor”: “feedly-nikon-v3.1”,
“contentType”: “image/jpeg”,
“url”: “https://i.insider.com/66a40340a0fc5856d597e9b4?format=jpeg”,
“width”: 1529,
“height”: 1147
},
“created”: “2024-07-27T10:27:30.630Z”,
“summary”: {
“content”: “Researchers at project CETI are harnessing the power of AI to decode whale-speak.”,
“direction”: “ltr”
},
“updated”: “1970-01-01T00:00:00.000Z”,
“keywords”: [
“Science”,
“conservation”,
“research”,
“whales”,
“marine-biology”,
“artificial-intelligence”
],
“canonical”: null,
“enclosure”: null,
“thumbnail”: [
{
“url”: “https://i.insider.com/66a40340a0fc5856d597e9b4?format=jpeg”,
“width”: 1529,
“height”: 1147
}
],
“engagement”: 64,
“engagementRate”: 0.33,
“IMTLENGTH”: 5,
“IMTINDEX”: 1
},
{
“id”: “hi5AdeofZRQYPC5jE7fvCuxVgGi2FnqaGixCRkwQOjE=_190e91b1a6f:17bbe:9b7668c4”,
“href”: “Martech Will Drive Digital Customer Engagement”,
“title”: “How Martech Will Drive the Next Generation of Digital Customer Engagement”,
“author”: “MTS Staff Writer”,
“source”: {
“url”: “https://www.martechseries.com/”,
“title”: “MarTech Series”,
“streamId”: “feed/MarTech Series”
},
“visual”: {
“processor”: “feedly-nikon-v3.1”,
“contentType”: “image/jpeg”,
“url”: “https://martechseries.com/wp-content/uploads/2024/07/How-Martech-Will-Drive-the-Next-Generation-of-Digital-Customer-Engagement-2.jpg”,
“width”: 2300,
“height”: 1300
},
“created”: “2024-07-25T08:56:25.967Z”,
“summary”: {
“updated”: “1970-01-01T00:00:00.000Z”,
“keywords”: [
“AI/ML”,
“Analytics”,
“Content”,
“CRM”,
“Customer Data Platforms”,
“Customer Experience Management”,
“Marketing Automation”,
“Privacy and Regulations”,
“Staff Writers”,
“Technology”,
“AI assistants”,
“AI Assistants and Voice Search”,
“Analytics tools”,
“AR and VR”,
“Communications”,
“consumer behavior”,
“content management system”,
“customer data”,
“customer engagement”,
“customer relationship management”,
“Customer-to-Community Engagement”,
“Customer-to-Company Engagement”,
“Customer-to-Content Engagement:”,
“Ethics and Data Privacy”,
“Featured”,
“Generative AI”,
“Improved Customer Retention”,
“Increased Customer Satisfaction”,
“Indistinct Identities Between Intention and Reality”,
“marketing automation”,
“Next-Generation”,
“personalization”,
“Streamlined Customer Journey”,
“Transparency to Foster Trust”
],
“canonical”: null,
“enclosure”: null,
“thumbnail”: null,
“engagement”: 2,
“engagementRate”: 2,
“IMTLENGTH”: 5,
“IMTINDEX”: 2
},
You didn’t give me everything but from the two bundles you gave me I was able to complete this.
You need to use the source.url from feedly not the address.
The output was too long and i couldn’t add it all because it had link and my account is new so my bad. The source url is scraped but how do i add each scraped article to a separate variable?
As sam said you need to use an aggregator after your scraptio.
