Welcome to the Make community!
For web scraping, some apps you can use are ScrapingBee and ScrapeNinja to get content from the page.
I’ve used ScrapeNinja, and you can use jQuery-like selectors there in the extractor function.
ScrapeNinja also can run the page in a web-browser using the “Scrape (Real Browser)” module so it closely emulates what users see, as opposed to just the raw page HTML fetched from the HTTP module.
If you want an example, take a look at Grab data from page and url - #5 by samliew
One thing to note, is that sometimes the scraping services do more than just fetch the resulting page - they might also do error handling, or retries, or bypass firewall (Cloudflare), etc., so it can be more reliable than just the standard HTTP module.
If you read about ScrapeNinja on their website,
ScrapeNinja handles headless browsers, proxies, timeouts, retries, and helps with data extraction, so you can just get the data in JSON.
Rotating Proxies, Unlimited Volume.
ScrapeNinja uses high quality proxies under the hood, so you don’t spend time managing and monitoring them, and it won’t break your bank.
Chrome Fingerprint Emulation
Getting blocked when scraping using CURL or PHP? ScrapeNinja emulates real Chrome request, without Puppeteer overhead (but JS evaluation is available, too!).
Smart Retries
ScrapeNinja retries based on timeout, response code and page text.
JS Evaluation
Choose if you want to evaluate JS (launch real headless browser) or perform raw network request (to get best performance and lowest latency possible). Experiment and switch between 2 network engines of ScrapeNinja on the fly.
Extract pure data from HTML. Faster.
Rapidly write & test simple JS snippets in online editor, to extract JSON from arbitrary HTML, via JS Extractors feature.
Build and test scrapers right in your browser.
Rapidly build and test web scraper in online builder, without writing a single line of code. Copy&paste generated web scraper code to your environment when you are done.
Links
Here are some useful links and guides you can use to learn more on how to use the Make platform, apps, and app modules. I found these useful when I was learning Make, and hope they might benefit you too —
General
- Help Center | Tutorials
- Make Academy – learn Make and get your certificate
- Make Blog – get the latest updates
- Features & Pricing
Help Center Basics
- Mapping – What is mapping? What can I map?
- Mapping with arrays – How to map items in an array
- Tokens for
parseDate| Tokens forformatDate - HTTP modules – Make a request, Get (download) a file
- Webhooks – Error Handling, Responding to webhooks
Articles & Videos
- Router Magic Formula - YouTube
- Error Handlers in Make - YouTube playlist
- Getting started with OpenAI
- How to use Regex in Make