Hi everyone, Question: Is there any way to automatically pull text from links that are sent to chat in telegram? For example, someone sends a link to an article to the chat. I need this text to be automatically extracted so that I can further include this text in the automation chain. Thanks for your help!
You can use the Text Parser “Match Elements” module to match the links in text.
Let me know if you need further assistance.
samliew – request private consultation
Join the Make Fans Discord server to chat with other makers!
1 Like
I’m afraid I’ve misspoken. What I meant was that I specifically need the text that is on the site when you click on the link. I.e. if it’s a link to an article, then I need the text of that article.
You can use the HTTP module to fetch the source code of the URL.
1 Like
Thanks for your help, it would also be just great if you could share screenshots of what it looks like
For web scraping, some apps you can use are ScrapingBee and ScrapeNinja to get content from the page.
I’ve used ScrapeNinja, and you can use jQuery-like selectors there in the extractor function.
ScrapeNinja also can run the page in a web-browser so it closely emulates what users see, as opposed to just the raw page HTML fetched from the HTTP module.
If you want an example, take a look at Grab data from page and url - #5 by samliew
samliew – request private consultation
Join the Make Fans Discord server to chat with other makers!
1 Like
You can extract text using HTTP module “Make a Request”.
Also, you can create articles from links using the Perplexity module.
To learn about advanced scrapping, check out the video here.
Regards,
Msquare Automation - Gold Partner of Make
Explore our YouTube Channel for valuable insights and updates!
Thanks for your help. Do you know if there is a way to make the text of the article stand out from all the text that is extracted? There’s just a lot of unnecessary text in there