Hello I hope all of you are having a great time 
I’m trying to use the HTTP module to log into a website, It’s working but trying to get data after logging in seems it doesn’t work.
In the next HTTP module where I try to get the date it does not work:
if you have solved this before please a helping hand will be appreciated.
Hey @Rafael_Sanchez ,
I think you will have to first do a POST request with the login credentials, after that only you can have access to the content of the website.
Create a perfect body parameter with your details, also capture the session info.
After this you add one more module with a get request to get the data.
please try this and let me know
here you can see username and password are empty , you need to add them correctly
after that only you can post a proper request
However, as each website implements login differently, there is no straightforward way of doing this, and the process (modules/functions/etc.) needs to be specifically tailored to the site.
For more information, please see the topics of these users who have asked the same question before:
samliew – request private consultation
Join the Make Fans Discord server to chat with other makers!
I did that but it didn’t make a difference I tried before with the same results, I thought the session and cookie get in the previous HTTP request module would be used in the next HTTP Request Module to pass the session and cookie so the Get method could use it to get the data in the website. what I receive is a long string which is the page not logged in.
okay @Rafael_Sanchez I don’t think so that we can scape a website data in that way, can you brief about what you’re trying to do so that we can think of some alternatives.
Sure.
The website has two types of users:
Normal clients where prices are let’s say $20 for 15 Amp Breaker and
Partner clients where prices are let’s say $9.74 for the same breaker
So I need to log in as a Partner to get the partner price, and scrap the search I do to get the price.
the search toy can even test without being login in is Search Results
To log into the Website only email and password are needed no MFA.
this show the page search with no user logged in, but I can get it in HTTP Module and either if logged in.
@Rafael_Sanchez I don’t think so we need make for this, you easily scrap data using some other tech like python. if you want to send that scraped data to some other platform let’s say google sheets, you can do that easily.
let me know if you need further help on this
Helo @Anshul_Soni yo mean run python in a server or locally to scrap the data ?
or maybe a combination of services like Bardeen with Make, the goal is to have the most user-free intervention in the process.
For sure I will need more help I appreciate if you can guide me
@Rafael_Sanchez Right, first scrap the data with login credentials and then send it through make. If it all helped you mark this as solution so that we can have conversation after wards for different problems.
my contact details - Bento for contacts
Helo @Anshul_Soni sorry for late reply, I ended up doing a Google Cloud function with Python and invoking with Make it did the trick.
Thanks for you help and collaboration
