OpenAI is launching a new smart UI feature in ChatGPT that allows the chatbot to answer your questions with interactive images. The update, which is rolling out to all users alongside GPT-6, gives ChatGPT the ability to combine a text response with diagrams, tables, forms, tappable buttons, and more.
In a blog post explaining the change, OpenAI says it trained GPT-6 when to render interactive images over text, as well as how to format them in its response. An example shared by OpenAI shows how ChatGPT could display a diagram of a seven-speed bicycle if you ask about its design, complete with interactive buttons that highlight different parts.
Another shows how ChatGPT can teach you how to play Mahjong by generating images of each tile and placing them into categories that you can scroll through. You can also ask ChatGPT to generate tools for different tasks, such as a retirement savings calculator, a retro game, or a bill splitter. It will then generate the online tool with your response.
OpenAI announced its first GPT-6 models last month, but is now bringing the Sun and Moon versions to ChatGPT. In addition to enabling smart UI, OpenAI says its GPT-6 enables ChatGPT to perform better web searches and provide faster partial responses to users while collecting information. The company notes that GPT-6 also “showed increased resistance to attempts to circumvent its security training.”
GPT-6 with Smart UI will roll out globally to ChatGPT Plus, Pro, Business, and Enterprise users starting today, but will expand to the Go and free tiers on Thursday. While top-tier subscribers will get access to the mid-range GPT-6 Sol model, Go and free users will be able to use the more efficient GPT-6 Luna.
