Help, I have a link to a website with META Facebook ads.
I need to be able to collect all the ad information and send it to Telegram. The HTTP module just returns empty text when I click the link. Link - https://www.facebook.com/ads/library/?active_status=active&ad_type=all&country=ALL&is_targeted_country=false&media_type=all&search_type=page&source=page-transparency-widget&view_all_page_id=219638118142025
Meta Sulpak.blueprint.json (34.2 KB)
Welcome to the Make Community!
To allow us to assist you with your scenario, please provide the following:
Please share screenshots of your scenario, any error messages, relevant module fields, and filters in question? It would really help other community members to see what you’re looking at.
Please export the scenario blueprint file to allow others to view the mapped variables in the module fields. At the bottom of the scenario editor, you can click on the three dots to find the Export Blueprint menu item.
Please provide the output bundles of the modules by running the scenario (or get from the scenario History tab), then click the white speech bubble on the top-right of each module and select “Download input/output bundles”.
Providing the input/output bundles will allow others to replicate what is going on in the scenario even if they do not use the external service.
Following these steps will allow others to assist you here. Thanks!
i made, help plz,
The whole problem is that the code comes from this link and after the parser text, the resulting text is empty, but I need it to give out all the information from the site about advertising.
Ah. You are using the HTTP module to scrape a page that cannot be scraped.
I suggest using the Meta API to get the ads data you need:
So you basically need to “visit” the site yourself to get the content. This is called Web Scraping.
Are you getting NO output from the HTTP “Make a request” module? This is because the website has employed anti-scraping measures, and has detected that the visit is not made by a human, and has blocked the request silently by returning no content.
Are you getting NO output from the Text Parser “Match pattern/elements” modules? This is because there is NO text content in the HTML! The entire page content you are scraping is hosted in a script tag, which is dynamically generated and placed onto the page using JavaScript when loaded and run on the user’s web browser on the client-side.
Make is a server-side runtime environment, so using the HTTP modules, you get just the script tags, and those script tags are ignored by the Text Parser “HTML to Text” module because it is NOT a HTML layout element. Using the Make HTTP “Make a request” module does NOT run any of those JavaScript, so there is no content on the page other than a default message that tells you to enable JavaScript.
This is NOT a Make platform, apps, or Text Parser, or Regular Expression issue/bug.
You CANNOT use normal scraping integrations like ScrapingBee or HTTP “Make a request” module to fetch pages from this website.
For more information and demo using ScrapeNinja, see Scraping Bee Integration Runtime Error 400
For web scraping, a service you can use is ScrapeNinja to get content from the page.
ScrapeNinja allows you to use jQuery-like selectors to extract content from elements by using an extractor function. ScrapeNinja also can run the page in a real web-browser, loading all the content and running the page load scripts so it closely simulates what you see, as opposed to just the raw page HTML fetched from the HTTP module.
If you want an example, take a look at Grab data from page and url - #5 by samliew
You can also use AI-powered web scraping tools like Dumpling AI.
This is probably the easiest and quickest way to set-up, because all you need to do is to describe the content that you want, instead of inspecting the element to create selectors, or having to come up with regular expression patterns.
The plus-side of this is that such services combine BOTH fetching and extracting of the data in a single module (saving operations), and doing away with the lengthy setup from the other methods.
For more information on the different methods of web scraping, see Overview of Different Web Scraping Techniques in Make 🌐
Hope this helps! If you are still having trouble, please provide more details.
— @samliew
