Inconsistent Outputs from OpenAI Assistant module

How To
, , ,
1

Hi everyone,

I’m experiencing issues with the consistency of outputs from my OpenAI assistant. I’ve created an assistant using the 4o-mini model and set up a system prompt to analyze a PDF and summarize it. When I test this in the Playground, the output is as expected and works perfectly.

However, when I run it through Make.com using the OpenAI Message Assistant module, the responses become inconsistent. Sometimes it can’t read the PDF or extract data, or the module says it “Run has been ended with an invalid status “failed”. Sorry, something went wrong.” while other times it works perfectly. Additionally, there are instances where the output is missing some data or doesn’t include all the expected information.

Has anyone encountered similar issues or have suggestions on how to improve the consistency of outputs? Any help would be greatly appreciated!

1 Like
2

Share your instruction when error occured so that I can look into that.

3

How are you uploading the PDF?

To allow others to assist you with your scenario, please provide the following:

1. Relevant Screenshots

Please share screenshots of your scenario, any error messages, relevant module fields, and filters in question? It would really help other community members to see what you’re looking at.

You can upload images here using the Upload icon in the text editor:

2. Scenario Blueprint

Please export the scenario blueprint file to allow others to view the mapped variables in the module fields. At the bottom of the scenario editor, you can click on the three dots to find the Export Blueprint menu item.

3. Output Bundles of Modules

Please provide the output bundles of the modules by running the scenario (or get from the scenario History tab), then click the white speech bubble on the top-right of each module and select “Download input/output bundles”.

A. Upload as Text File

Save each bundle contents in your text editor as a bundle.txt file, and upload it here into this discussion thread.

B. Insert as Formatted Code Block

If you are unable to upload files on this forum, alternatively you can paste the formatted bundles.
These are the two ways to format text so that it won’t be modified by the forum:

  • Method 1: Type code block manually

    Add three backticks ``` before and after the content/bundle, like this:

    ```
    content goes here
    ```

  • Method 2. Highlight and click the format button in the editor

Providing the input/output bundles will allow others to replicate what is going on in the scenario even if they do not use the external service.

Following these steps will allow others to assist you here. Thanks!

4

Thanks but i managed to figure out the issue or at least get it more consistent.

First issue was for some reason jotiforms (this is used to get a user to upload the pdf’s) had switched on “require sign to view uploads” which corrupted the “http download file” module.

2nd issue i used pdfco to parse the pdf to plain text first then uploaded the text file to vector store and is alot more consistent.

1 Like