Hi, I have a scenario where I need to scrap webpages.
I am using the “real browser” scrapninja module, but with a free account I quickly get to the maximum permitted, while with a "normal "scrpninja module I can do much more scrapping.
So I tried to add an error handler so if the “normal” one fails, it goes to the “real browser” one.
But when I get an error on the first one, I don’t see the flow going to the second one.
This is the diagram:
And this is what happens when there is an error, you can see the output has a error message:
But the nothing happens in the “real browser” module:
Looks like ScrapeNinja is not properly following the 302 redirect for this particular website, or correctly throwing any errors.
In this case, you cannot use the error handler.
You can contact support to request the developer of ScrapeNinja module to fix the error.
For bugs like this, directly contacting support can often lead to a faster resolution. They have access to your specific account details, scenario and scenario logs, server-side logs, and internal tools and resources, which allows them to investigate more thoroughly than what you have access to. Additionally, sharing sensitive information about your situation might not be suitable for an open forum discussion.
You can open a new ticket, or if you are unable to login for some reason, you also can reach support using the contact form on the website.
If you manage to get your issue resolved with support, we’d still love to hear about it! Sharing your solution on the forum can help others facing similar problems.
A workaround is to use a Router with a filter for non-error, and a fallback route for error.
2 Likes