OpenAI launches GPT-4 Turbo with Vision in ChatGPT: What’s new and what can you do?

OpenAI, a leading artificial intelligence research and deployment company, announced the launch of GPT-4 Turbo with Vision in its widely used artificial intelligence chatbot ChatGPT. This enhanced functionality can also be accessed through the application programming interface (API). With this update, users with paid accounts on ChatGPT can now enter images to receive responses. Let’s delve into the capabilities of the newly launched GPT-4 Turbo with Vision.

GPT-4 Turbo with vision: What’s new?

The latest version of GPT-4 Turbo has a capacity of up to 128,000 tokens, which is a significant leap compared to the 8x increase of GPT-3.5 Turbo. Tokens act as chunks of data that are input to the model for processing. This updated model includes information up to December of the previous year, ensuring users receive more relevant and up-to-date responses.

Also Read: WhatsApp launches Meta AI chatbot for select users in India: What is it and how to use it

According to OpenAI’s official blog post, “GPT-4 Turbo with Vision enables models to interpret images and provide image-related answers.” Additionally, it can handle media input via Uniform Resource Locators (URLs). Although GPT-4 Turbo is the most advanced technology the company has ever developed, it does have certain limitations.

Also read: Investors pleased with Google’s AI progress, Alphabet set for new record

Limitations and Scope

OpenAI clarifies that the model may have difficulty correctly analyzing medical images such as CT scans, images containing non-English or small text, charts, stylized text, panoramic or fisheye images, etc. Additionally, the system is not designed to handle verification codes. Users can upload image files in PNG (.png), JPEG (.jpeg and .jpg), WEBP (.webp) and non-animated GIF (.gif) formats, with a size limit of 20MB per image.

Also read: Google adds two new AI models to its Gemma LLM series – why this matters

“We will automatically delete images after the model has processed them,” OpenAI promises. In addition to image processing capabilities, GPT-4 Turbo also offers website creation from scratch, coding assistance, and more. GPT-4 Turbo is available to ChatGPT Plus users, with subscription prices starting at $20 (approximately Rs. 1,660) per month in India.