Hi!
I’m completely new to make and really excited about the possibilities this tool unlocks me.
I have a list (around 800) websites and I wanted to offer my social media service for every e-commerce website who have an Instagram page.
I thought about using make to “scrape” the website, search for the Instagram url (website code source) and bring me back the Instagram url in a spreadsheet.
I’m a solo entrepreneur so really low budget here.
No problem to split this effort in 2 or 3 months to avoid upgrading my plan.
Is it this doable? Can I do it as a newbie?
Thanks for taking the time to read it 
Welcome to the Make community!
Yes, that is possible. You’ll need a minimum of three modules:
This is just an example. Your final solution may or may not look like this depending on your requirements.
For web scraping, some apps you can use are ScrapingBee and ScrapeNinja to get content from the page.
I’ve used ScrapeNinja, and you can use jQuery-like selectors in the extractor function.
Example Use
Example Output
ScrapeNinja also can run the page in a real web-browser, loading all the content and running the page load scripts so it closely simulates what you see, as opposed to just the raw page HTML fetched from the HTTP module.
If you want an example, take a look at Grab data from page and url - #5 by samliew
For more information on the different methods of web scraping, see Overview of Different Web Scraping Techniques in Make 🌐
Hope this helps! Let me know if there are any further questions or issues.
— @samliew
P.S.: Did you know, the concepts of about 70% of questions asked on this forum are already covered in the Make Academy. Investing some effort into it will save you lots of time and frustration using Make later!
