Strategies for Fetching Full Text from Webpages Requiring Login (using http modules)

Hello everyone,

I’m currently facing a challenge and would appreciate any insights or advice from this knowledgeable community. My goal is to extract data from a specific webpage. However, I’ve encountered a significant hurdle: the webpage restricts access to the full text unless a user is logged in. This limitation poses a problem for my project, as I need to access the complete content for it to be successful.

I’m exploring potential methods or tools that could help me navigate this issue, specifically in scenarios where direct login through conventional automation or scripting might not be straightforward or possible. If anyone has experience with similar challenges or knows of effective strategies to fetch data from webpages with login requirements, your guidance would be incredibly valuable.

Thank you in advance for your time and assistance.

Did you have an update on this one @Karamjit_Singh? This is the same issue that I am having as well. I can make it work on Power Automate but am having an issue with it here on Make.

Please provide example web page with example login details, and a screenshot of what you want to extract.

2 Likes