1 month ago
Among different features, Codex now features a built-in image generator and web browser. (OpenAI)
Last month, pursuing reporting from The Wall Street Journal, OpenAI confirmed it was moving connected a desktop ace app that would harvester ChatGPT, its Codex coding agent and Atlas web browser into 1 cohesive experience. OpenAI is not releasing that exertion today. Instead, it's pushing retired a major update to Codex that importantly expands what that package tin do. However, nan caller merchandise offers a glimpse of what OpenAI hopes to build pinch its latest effort.
"We're building nan ace app retired successful nan open," said Thibault Sottiaux, nan caput of Codex, during a property briefing held by OpenAI. "This merchandise is astir developers. In nan future, we will broaden it up to a wider audience." Until then, nan latest type of Codex offers developers multi-purpose AI agents that tin activity crossed a "larger aboveground area," while being much proactive. In practice, that translates to a big of caller capabilities, starting pinch machine use.
The agents wrong of Codex tin interact pinch different apps connected your PC. When prompting 1 of OpenAI's models, you tin sanction a circumstantial programme aliases fto it find nan champion exertion for nan job. Computer usage is disposable successful competing apps for illustration Claude Cowork, but wherever OpenAI believes Codex offers an separator successful that section is successful nan "secret sauce" it built to let an supplier to tally an app without bogging down your full system, truthful nan 2 of you tin activity successful tandem. At nan aforesaid time, OpenAI is releasing 111 caller plugins for Codex that harvester skills, app integrations and exemplary discourse protocol server connections to give Codex much ways to stitchery discourse and usage nan devices developers dangle connected for their work.
The institution has besides added a built-in browser, pinch a commenting strategy that allows you to punctual Codex to make tweaks to circumstantial parts of a webpage aliases web app you're building. In nan demo OpenAI showed, 1 personnel of nan Codex squad utilized this instrumentality to instruct Codex to alteration nan margins connected a chart truthful that nan y axis wasn't trim off. Complementing this is built-in image generation. Codex tin usage gpt-image-1.5 to create merchandise concepts, mockups, frontend designs and moreover assets for elemental games. It besides allows Codex to usage screenshots to verify it's connected nan correct way pinch a personification request.
With today's update, OpenAI is besides previewing a brace of representation features. The first allows Codex to callback discourse from erstwhile tasks to pass really it goes astir early prompts. According to OpenAI, pinch time, this will let Codex to complete requests faster and to a higher standard. The app will besides usage nan discourse it's gathered to propose proactive actions. For example, astatine nan commencement of your day, it mightiness propose you respond to a remark a coworker near connected a Google Doc draught you wrote.
If you want to effort nan updated Codex for yourself, OpenAI is starting to rotation retired nan caller type to desktop app users who are logged successful pinch their ChatGPT account. Computer usage is disposable to macOS users first, pinch readiness for group successful nan EU and UK to travel soon. Similarly, Brits and Europeans will request to hold to effort nan representation features OpenAI has built into Codex.
