I haven’t written about Jev. I had too much going on this month. But the AI world was going nuts about it because it was a type safe way to leverage AI in code. Unstructured in, structured out.
Last month, I wrote about my FoundationModels in iOS27 explorations where I used an on-device LLM to make decisions on code. I was amazed at how complex algorithmic instructions could be done with a simple prompt, and then used to direct my application logic. The problem was that comparing deterministic algorithms with LLM reasoning is no contest. I knew it would be slow and had to restrict where I would use this type of decision making.
Jev changed all that last month where models came out that were trained to act fast and make decisions. Suddenly integrating an LLM into code was no longer a liability.
OpenAI noticed. And today, released Decisions API. The video below shows its use in code, with the video game steering demo being most interesting to me because it highlights the quickness and accuracy of the LLM to code decision making. But wait, this is not text, this is also multi-model as it can process images and act on it… within 150ms! “ms”!
While it isn’t coding fast, it is way faster than your typical frontier model response of multiple seconds. Which makes integrating LLM into code a viable option. Coding has changed more this past 12 months than it has in 10 years.
Leave a Reply