I am trying to parse the text from telegram notifications I am signed up for. They are trade alerts. I’ve included a sample alter here. I want to set it to a webhook that I can cannect to my trading bot to execute my trades. For some reason i cannot get the text parsing module to work for me. I have been using chatgpt to instruct but it’s not working.
Welcome to the Make community!
If you’re not the admin of the channel, you cannot connect a bot to it to receive updates.
You can however, scrape the webpage of the channel to get the latest message.
For more information, see below.
So you basically need to “visit” the site yourself to get the content. This is called Web Scraping.
Incomplete Scraping
Are you getting NO output from the Text Parser “HTML to Text” module? This is because there is NO text content in the HTML! The entire page content you are scraping is hosted in a script tag, which is dynamically generated and placed onto the page using JavaScript when loaded and run on the user’s web browser on the client-side. Make is a server-side runtime environment, so using the HTTP modules, you get just the script tags, and those script tags are ignored by the Text Parser “HTML to Text” module because it is NOT a HTML layout element.
Using the Make HTTP “Make a request” does NOT run any of those JavaScript scripts, so there is no content on the page other than a default message that tells you to enable JavaScript.
This is NOT a Make platform, or Text Parser, or Regular Expression issue/bug.
You CANNOT use normal scraping integrations like ScrapingBee or HTTP “Make a request” module to fetch this page’s structure.
You will need to use ScrapeNinja’s “Scrape (Real browser)” module to emulate a real person visiting the site using a web browser, as client-side JavaScript needs to run to parse the JSON data in the script tags, and generate the page structure and content.
For more information and demo using ScrapeNinja, see Scraping Bee Integration Runtime Error 400
Web Scraping
For web scraping, a service you can use is ScrapeNinja to get content from the page.
ScrapeNinja allows you to use jQuery-like selectors to extract content from elements by using an extractor function. ScrapeNinja also can run the page in a real web-browser, loading all the content and running the page load scripts so it closely simulates what you see, as opposed to just the raw page HTML fetched from the HTTP module.
If you want an example, take a look at Grab data from page and url - #5 by samliew
AI-powered “easier” method
You can also use AI-powered web scraping tools like Dumpling AI.
This is probably the easiest and quickest way to set-up, because all you need to do is to describe the content that you want, instead of inspecting the element to create selectors, or having to come up with regular expression patterns.
The plus-side of this is that such services combine BOTH fetching and extracting of the data in a single module (saving operations), and doing away with the lengthy setup from the other methods.
More information, other methods
For more information on the different methods of web scraping, see Overview of Different Web Scraping Techniques in Make 🌐
Hope this helps! Let me know if there are any further questions or issues. P.S.: investing some effort into the tutorials in the Make Academy will save you lots of time and frustration using Make!
— @samliew
Chatgpt gave me this.. FilterBox (Android app) – Filters only messages with keywords like “bingx” or “bitunix” and forwards them via webhook to Make.com.
So I am using my notifications to bypass not being admin. Everything works until I try to get specific info parsed.
You have not yet provided sufficient information about your scenario to demonstrate the problem that would allow us to reproduce the scenario and any error(s).
To allow others to assist you with your scenario, please provide the following:
1. Relevant Screenshots
Could you please share screenshots of your full scenario? Also include screenshots of any error messages, module settings (fields), relevant filter settings (conditions), and module output bundles. We need to see what you’re working with to give you the best advice.
You can upload images here using the Upload icon in the text editor:
We would appreciate it if you could upload screenshots here instead of linking to them outside of the forum. This allows us to zoom in on the image when clicked, and prevent tracking cookies from third-party websites.
2. Scenario Blueprint
Please export the scenario blueprint. Providing your scenario blueprint file will allow others to quickly recreate and see how you have set up the mappings in each module, and also allows us take screenshots or provide module exports of any solutions we have for you in return - this would greatly benefit you in implementing our suggestions as you can simply paste module exports back into your scenario editor!
To export your scenario blueprint, click the three dots at the bottom of the editor then choose ‘Export Blueprint’.
You can upload the file here by clicking on this button:
3. Output Bundles of Modules
Please provide the output bundles of each of the relevant modules by running the scenario (you can also get this without re-running your scenario from the History tab).
Click on the white speech bubbles on the top-right of each module and select “Download input/output bundles”.
A. Upload as a Text File
Save each bundle contents in a plain text editor (without formatting) as a bundle.txt file.
You can upload the file here by clicking on this button:
B. Insert as Formatted Code Block
If you are unable to upload files on this forum, alternatively you can paste the formatted bundles.
These are the two ways to format text so that it won’t be modified by the forum:
-
Method 1: Type code block manually
Add three backticks
```before and after the content/bundle, like this:```
content goes here
``` -
Method 2. Highlight and click the format button in the editor
Providing the input/output bundles will allow others to replicate what is going on in the scenario, especially if there are complex data structures (nested arrays and collections) or if external services are involved, and help you with mapping the raw property names from collections.
Sharing these details will make it easier for others to assist you.
](https://europe1.discourse-cdn.com/flex013/uploads/make/original/3X/f/4/f46379ea4b4ee58459f5bf76aec6b39faee6be60.png)
blueprint.json (13.3 KB)
bundle.txt (400 Bytes)
chatpgt keeps telling me to map using drop downs that don’t exist or click puzzle pieces to imput information. Some fields are left blank because I don’t have any idea of where to imput the information. thanks for the help and patience.
Firstly, set this to no so that if there are no matches, the subsequent modules do not continue.
Next, I need an output bundle of the Webhook trigger module, which you have not provided.
chatgpt was insistent that it be sent to yes, not as easy a process as I would have liked. haha I’m adjusting my filter and will upload the output over the next day or so. Thanks again for the help.
filterbox outputs.txt (3.1 KB)
i think thats the info you are asking for. let me know if i’m wrong
The output bundle doesn’t seem to contain any useful information to be extracted. You might want to check the configuration of the service you are using to send the correct data to the webhook.
Hope this helps! Let me know if there are any further questions or issues. P.S.: investing some effort into the tutorials in the Make Academy will save you lots of time and frustration using Make!
— @samliew