How to Scrape Any Website using Make?

Showcase
1

In this video, We’ll show you how to scrape any website using Make and leveraging the power of AI.

First, We’ll demonstrate how to gather data from any online source and transform it into structured, usable information using AI techniques. We’ll then store the scraped data securely in a Google Sheet.

Next, We’ll take you through scraping a large, multinational data source like Zillow. We’ll build custom parsers, apply clever headers to avoid detection mechanisms and show you how to export the extracted data to a Google Sheet for further analysis or use cases.

Buckle up as we explore the world of web scraping, harnessing AI capabilities to extract valuable insights from websites efficiently and reliably.

P.S: Between, more videos are in the pipeline. Comment the videos you look forward in coming days.

Check out this video:

maxresdefault (3)
maxresdefault (3)1280×720 56.9 KB

3 Likes
2

@Msquare_Automation Nicely done! I also recommend the use of the XML > Perform XPath Query to target elements in the source code :slight_smile:

3 Likes
3

@hideyukishibata Thanks for the feedback. Will try the same and see the results.

1 Like
4

is there somewhere I can learn about XML Perform XPath? I’m trying to get only the article content plus main image url from a webpage

2 Likes
5

Hey sorry I missed your comment. This might help you get there (my own Medium post):

If you still can’t figure out the right XPath, drop a link here and I’ll see what I can do!

Thanks.

6

There is more than one way to scrape data from websites. I have a Overview of Different Web Scraping Techniques in Make forum thread which is linked on my profile.

Hope this helps!

— @samliew

7

Thanks for all your feedback.