What are you trying to achieve?
Hi everyone,
I’ve created an automation in Make.com where I scrape LinkedIn profile data using HTTP requests. Here’s how my setup works:
The input is a Google Sheet where I add LinkedIn profile URLs.
The scenario triggers whenever a new row is added to the sheet.
It makes an HTTP request to the LinkedIn profile URL, scrapes the HTML, and converts it to text using the TextParser module.
I extract the location and the number of connections from the scraped text and update the Google Sheet with these details.
This works fine for the first few URLs, but after about 5–6 successful requests, I encounter an Error 999. This causes the scenario to fail.
Questions:
Is there a better way to bypass the Error 999 while scraping LinkedIn profiles? As i have a bulk of urls.
I would really appreciate your guidance on how to make this workflow more robust and avoid LinkedIn’s blocking mechanisms.
Thanks in advance!
Steps taken so far
Adding delays between requests (like running only 1 url in 5 minutes - Still shows error) Although this is not scalable as i have many urls in a day to scrape.
