I want to create an ELT Solution for downloading bulk files from different sources like SalesForce, OneDrive, Docusign, etc

I have a web app in React and I want to create an integration center for my Users where they can connect to different sources, select folders/files of that source and can import it in my website. Is there a solution in Make that would make the OAuth flow and integration flow simpler?

I would have multiple users using this feature, so the OAuth and Folder/File download needs to be dynamic for each users.

. For creating an ELT (Extract, Load, Transform) solution to download bulk files from various sources like Salesforce, OneDrive, and Docusign, Make.com offers a comprehensive set of tools to simplify and automate this process. Here’s a practical approach to achieve this:

  1. Extract: Set up Make scenarios to connect to each source (Salesforce, OneDrive, Docusign) using their respective APIs. Use OAuth 2.0 for secure authentication and authorization. Make supports a wide range of connectors that can help you extract files and data efficiently.
  2. Load: Once the files are extracted, store them in a centralized location such as a cloud storage service (e.g., AWS S3, Google Cloud Storage) or a database. This ensures all your files are in one place, ready for transformation and analysis.
  3. Transform: Implement data transformation processes to clean and format the data as needed. This can include file conversion, renaming, data normalization, and more. Make.com allows you to create complex workflows to automate these transformations.

Here’s a more detailed breakdown:

  • Salesforce Integration: Use Make.com to connect to Salesforce via OAuth, schedule regular data extractions, and handle bulk API requests for large datasets.
  • OneDrive Integration: Authenticate users through OAuth, browse and select folders/files dynamically, and automate downloads.
  • Docusign Integration: Securely connect to Docusign, extract documents, and handle bulk operations.