"Scrape" or just "Visit" a website with Login

Hi,

Im currently trying to play with scraping a website with a login session via Make
However I couldn’t make it successfully

My workflow

1/ HTTP POST Request with username, password

=> Success, note that i receive the ‘Token’

2/ Json Parse the token

=> Success

3/ Check the header of the website and copy to ScrapeNinja setting

and

=> Status success
4/ After I ran the workflow, ScrapeNinja should be able to “visit” the dashboard but the status is “not logged in”

Im assuming the ‘token’ is what needed to keep the login status from Step 1
Did I miss something here ?

Thank you

Welcome to the Make community!

It really depends on the site, which we don’t know about.

I couldn’t open the screenshots, could you upload them directly into your post?

To allow others to assist you with your scenario, please provide the following:

Relevant Screenshots

Please share screenshots of your scenario, any error messages, relevant module fields, and relevant filter settings. It would really help other community members to see what you’re looking at.

You can upload images here using the Upload icon in the text editor:

Scenario Blueprint

Please export the scenario blueprint file to allow others to view the mapped variables in the module fields. At the bottom of the scenario editor, you can click on the three dots to find the Export Blueprint menu item.

Output Bundles of Modules

Please provide the output bundles of the modules by running the scenario (or get from the scenario History tab), then click the white speech bubble on the top-right of each module and select “Download input/output bundles”.

A. Upload as Text File

Save each bundle contents in your text editor as a bundle.txt file, and upload it here into this discussion thread.

B. Insert as Formatted Code Block

If you are unable to upload files on this forum, alternatively you can paste the formatted bundles.
These are the two ways to format text so that it won’t be modified by the forum:

  • Method 1: Type code block manually

    Add three backticks ``` before and after the content/bundle, like this:

    ```
    content goes here
    ```

  • Method 2. Highlight and click the format button in the editor

Providing the input/output bundles will allow others to replicate what is going on in the scenario even if they do not use the external service.

By providing these details, it will allow others to assist you better.

Hi,

Thank you for your quick reply

Screenshot1

Screenshot2

Screenshot3

Screenshot4

Blueprint
blueprint.json (32.1 KB)

I personally think those information above is enough.
If you need the bundles too, please just tell me.

Thank you

@samliew could you kindly take a look at this? truly appreciate your help.

That’s not enough information about the site you are scraping.

If you need further assistance, please use the Hire a Pro category, where you can receive private 1-to-1 assistance via video call/screenshare/private messaging/etc. This may help you get your issue resolved faster especially if it is urgent, or contain sensitive information. It is important to post your request in the Hire a Pro category, as forum members are not allowed to advertise their services in other categories like here (even if it’s free/unpaid). Once you have posted in the Hire a Pro category, that will allow other members to assist you over other forms of communication.

Hope this helps! Let me know if there are any further questions or issues.

@samliew

P.S.: Investing some effort into the Make Academy will save you lots of time and frustration using Make.

1 Like