Make AI Toolkit - AI response failed

Hello everyone,

I noticed my ChatGPT module has suddenly stopped parsing results as JSON, which is annoying in of itself. So, I thought i’d try the 'Make AI Toolkit, extract information from text’ instead, however, despite working the odd time, 95% of the time I’m getting the error message below. When I check the connection in the Connections tab, the connection is saying ‘This connection isn’t used in any scenarios’. Could this be related?

Any help would be appreciated. I’m starting to get a bit tired of trying to implement AI tools, I’m finding I’m having to address arising bugs and errors more often than I’m getting any benefit from them…

Hi,

Do you know why your ChatGPT module has stopped parsing results as JSON? Is it possible that the same reason it’s failing is the reason it’s failing in the AI module above? It’s possible that the AI input is invalid and causing problems. You probably checked that already, but just in case.

It’s abit odd that your connection isn’t being used. Yes, it could explain, but.…

L

Nope, it always worked. Then all of a sudden, it stopped working of its own accord. I’d understand if I modified the scenario in any way, but it just stopped working after it had been working for months.

Below is how I’ve setup the Make AI Toolkit module, with 6 other information entries. All plain text.

{5. Text} is just replacing data and links from the email body.

I’ve tried models Small, Medium and Large, and I get the same inconsistency with all of them.

I’m guessing the connection not showing up as connected to the scenario has something to do with it, but I’m not sure why…

image

There might have been a modification in the backend model that you’re using at OpenAI, and that may be why the original version stopped working. Can you clarify what you mean by “stopped parsing results as JSON”? That could give a clue.

For the error you receive, when you look at the incomplete queue, does it give any indication of why it did not complete and why the AI response failed? It could be that it doesn’t understand the input. You need to figure out when it works and when it doesn’t, what the difference in the input is. That could help you determine what the problem is and fix it.

Otherwise, I haven’t used the Make AI Toolkit. I usually use direct calls to the models of Claude, Gemini, or ChatGPT.

L

The ChatGPT module just started outputting the JSON without formatting it, so the prompt was working correctly otherwise. I guess a solution would be to use Make’s parse JSON module instead. It was just at this point that I decided to try Make’s new modules instead. However, they’re obviously not turning out to be any better by first impression…

Regarding the Error, I get no more information than my original screenshot. It’s hard to diagnose why it’s happening, as it works some of the time. For example, it’s failed 3 times out of the last 25 runs or so - which is obviously just too unstable to rely on.

I think I’ll find myself returning to the direct calls too. It does seem like a new module for a ChatGPT prompt has been released since the one I had that started being problematic. From a quick glance however, it didn’t seem to have the parse JSON functionality built in like the one I was using did.

Thanks for the help anyway, doesn’t seem like I’m going to get any other suggestions why Make’s own modules are playing up!

This looks like a bug to me.

Contact Make Support

For technical issues or bugs like this, contacting Make support by creating a ticket is the only official option available to Make customers.

Make support has access to server-side logs and has internal tools to investigate the issue further.

Search for Updates First

Before creating a support ticket, do try to look around if others are facing the same problem too. Here are some things you can do —

  1. Check the Make Status page to see if it is an ongoing network-wide issue/outage, and view any updates of internal investigations (example).

  2. Search this Make forum to see if there are any discussions, updates, and workarounds. Here are some possible search terms you can use:

    tags:error   bug   "not working"

How to Create a Support Ticket

If you are logged-in, you can head to the new ticket page to submit a ticket. (If you are unable to login to your main account, it is advised to create a free Pro account to access this page.)

Screenshot of the Create New Ticket page

After submitting your support ticket, you should receive a confirmation email with the subject “Ticket Created” together with a summary of what you submitted. If you do not receive this automated reply within minutes, try creating a ticket again.

Example of email subject: [#1234567] Ticket created | Technical challenge

Priority of Tickets

If you do not receive a response from Make support, simply be patient. Make support receives thousands of tickets daily, therefore they have to prioritise tickets based on the organisation’s subscription plan. For more information about the different levels of customer support, refer to the “Support” section on the Pricing page, or on your organisation’s Subscription tab. If you are a free customer, I recommend that you get a free Pro plan to get quicker support via the ticketing system.

Resolution

When your issue is resolved one way or another, we’d love to hear more details about the cause, and how you managed to solve it (including use of workarounds). By sharing your findings and solutions, we are contributing to this knowledgebase to enable others to search for answers to similar problems.

Hope this helps! Let me know if there are any further questions or issues.

@samliew