Hello I hope all of you are having a great time :slight_smile: I’m trying to use the HTTP module to log into a website, It’s working but trying to get data after logging in seems it doesn’t work. [image] In the next HTTP module where I try to get the date it does not work: [image] [image] i…

Hey @Rafael_Sanchez , I think you will have to first do a POST request with the login credentials, after that only you can have access to the content of the website. Create a perfect body parameter with your details, also capture the session info. After this you add one more module with a g…

thanks, @Anshul_Soni could you please guide me on those steps. This is what I have done so far: [image] [image] [image] [image]

@Rafael_Sanchez here you can see username and password are empty , you need to add them correctly after that only you can post a proper request [image]

However, as each website implements login differently, there is no straightforward way of doing this, and the process (modules/functions/etc.) needs to be specifically tailored to the site. For more information, please see the topics of these users who have asked the same question before: How to …

I did that but it didn’t make a difference I tried before with the same results, I thought the session and cookie get in the previous HTTP request module would be used in the next HTTP Request Module to pass the session and cookie so the Get method could use it to get the data in the website. what I…

okay @Rafael_Sanchez I don’t think so that we can scape a website data in that way, can you brief about what you’re trying to do so that we can think of some alternatives.

Sure. The website has two types of users: Normal clients where prices are let’s say $20 for 15 Amp Breaker and Partner clients where prices are let’s say $9.74 for the same breaker So I need to log in as a Partner to get the partner price, and scrap the search I do to get the price. the search …

@Rafael_Sanchez I don’t think so we need make for this, you easily scrap data using some other tech like python. if you want to send that scraped data to some other platform let’s say google sheets, you can do that easily. let me know if you need further help on this

Helo @Anshul_Soni yo mean run python in a server or locally to scrap the data ? or maybe a combination of services like Bardeen with Make, the goal is to have the most user-free intervention in the process. For sure I will need more help :slight_smile: I appreciate if you can guide me

@Rafael_Sanchez Right, first scrap the data with login credentials and then send it through make. If it all helped you mark this as solution so that we can have conversation after wards for different problems. my contact details - Bento for contacts

How Login into a website via HTTP Module and get Data after Login

Questions

Rafael_Sanchez July 29, 2024, 10:23am 12

Helo @Anshul_Soni sorry for late reply, I ended up doing a Google Cloud function with Python and invoking with Make it did the trick.

Thanks for you help and collaboration

Topic		Replies	Views
How Login into a website via HTTP Module and get Data after Login [again] Questions webhooks , connections , http , web-scraping	4	305	March 3, 2025
HTTP module with authentification logintoken hidden Questions connections	0	47	November 10, 2024
How to Scrape a Website that Requires Login? Questions	1	3899	June 13, 2022
HTTP Log In Request Questions http	1	1162	November 25, 2023
"Scrape" or just "Visit" a website with Login Questions connections	4	188	February 26, 2025

How Login into a website via HTTP Module and get Data after Login

Related topics