OpenAI ChatGPT Vision / DALLE3 API

How To
,
1

Hi all!

With the announcement today has anyone got GPT Vision / DALLE 3 working through the API?

I am struggling to find how to ‘upload’ an image for Vision
DALLE 3 just produces errors
Keen to try TTS too if anyone has ?

Thanks!

1 Like
2

Hey @KyleBehrend,

the OpenAI App does not have a specific module for this yet but you can use the Make an API Call Module.

{
    "model": "gpt-4-vision-preview",
    "messages": [
      {
        "role": "user",
        "content": [
          {
            "type": "text",
            "text": "PROMPT TEXT"
          },
          {
            "type": "image_url",
            "image_url": {
              "url": "IMG_URL"
            }
          }
        ]
      }
    ],
"max_tokens":3000
}
5 Likes
3

I can confirm that @Richard_Johannes approach works. Now I’m trying to get this to work with images sent via email. I’ve tried saving the attachment to OneDrive but GPT Vision doesn’t like loading from there. So now I’m trying to base64 encode the image before sending it to GPT Vision.

3 Likes
4

Joel,

Would you mind explaining how do I do to apply this information on make API call module? sorry if the question sounds stupid but, I dont know what to put on fields like, URL, method, headers, key value.

I’ve been trying to do it but it’s been hours with no progression

3 Likes
5

Thanks so much for the reply! :slight_smile: Can you please help me, what do I populate here? I keep getting errors:

CleanShot 2023-11-08 at 06.56.26
CleanShot 2023-11-08 at 06.56.261206×1090 104 KB

6

Hello,

I’ve found a different way to do it.

image
image363×954 39.3 KB

Enjoy it

3 Likes
7

{
“model”: “dall-e-3”,
“prompt”: " TYPE YOUR PROMPT HERE",
“n”: 1,
“size”: “1024x1024”,
“quality”: “standard”,
“style”: “vivid”
}

2 Likes
8

Works great!! Thanks.

9

Thanks everyone! I cannot get a file from Google Drive - anyone figured that out yet?

1 Like
10

im getting this on the code from
@Gian_Giannotti

[400] Your request contained invalid JSON: Extra data: line 10 column 1 (char 469)

{
“model”: “dall-e-3”,
“prompt”: "Create a cinematic and visually striking image that embodies the world of cryptocurrency and crypto trading. Imagine screens displaying real-time crypto trading stats, fluctuating graphs, and various cryptocurrency logos like Bitcoin, Ethereum, and others, symbolizing the global interconnectedness of crypto trading. DO NOT ADD TEXT OR CHARACTERS ",
“n”: 1,
“size”: “1024x1024”,
“quality”: “standard”,
“style”: “vivid”
}

11

i have actually got it working now
but https://oaidalleapiprodscus.blob.core.windows.net/private/org-PC0oOgevWgFDzANAfCDfxNna/user-Dw9E1nr1LVuOwthvP7bxSqad/img-bCy52DKPIBOPy0XACsZRDi6h.png?st=2023-11-08T02%3A51%3A15Z&se=2023-11-08T04%3A51%3A15Z&sp=r&sv=2021-08-06&sr=b&rscd=inline&rsct=image/png&skoid=6aaadede-4fb3-4698-a8f6-684d7786b067&sktid=a48cca56-e6da-484e-a814-9c849652bcb3&skt=2023-11-08T03%3A42%3A15Z&ske=2023-11-09T03%3A42%3A15Z&sks=b&skv=2021-08-06&sig=PRwFuuS20cH/Hd%2BlJNRZc8GZ4QMniqw

AuthenticationFailed

Server failed to authenticate the request. Make sure the value of Authorization header is formed correctly including the signature. RequestId:cdb5f612-701e-0024-66f6-11583e000000 Time:2023-11-08T03:52:29.1361141Z

Signature fields not well formed.

this is the result?

12

I think the API is down atm https://status.openai.com/

2 Likes
13

Try not to use dots in your prompt as this causes error

14

quotation marks neither

15

[400] Your request contained invalid JSON: Expecting property name enclosed in double quotes: line 2 column 1 (char 2)

2 Likes
16

this would be great, there is even the option now to post file or image URL, but it still won’t accept.

is there an explanation for this already somewhere?

17

Attached here is an installation for the models I developed:
https://www.make.com/en/hq/app-invitation/91cd0339d2ab1e9a7ca070171112e284

3 Likes
20

Hi Rabin
Thank you for doing this

Could you tell me how do I do to download to text to speech file. I can only see a binary result, with no link to download.

21

@Nguyen_Chau @Gian_Giannotti

Welcome to the Make community!

Your questions seem to have strayed from the original question that the thread starter initially asked.

In future, please create a new thread for each question. This makes it easier for others with the same problem to search for the answer, and for you to get the answers you need, since new threads have a different notification channel, and solved threads may be ignored by others. Thank you for your cooperation!

3 Likes
22

Sorry about that :grimacing:
I was so surprised with the module he created that I forgot the main purpose

2 Likes