> ## Content Index
> Fetch the complete content index at: https://www.taivo.ai/llms.txt
> Use this file to discover other available public pages before exploring further.

# A wild speed-up from OpenAI Dev Day
- URL: https://www.taivo.ai/__a-wild-speed-up-from-openai-dev-day/
- Published: 2023-11-07T20:21:30.000Z
- Updated: 2026-08-04T11:24:48.000Z
- Author: Taivo Pungas
- Tags: Everything else, stream

I'll share more thoughts on *OpenAI* Dev Day announcements soon, but one huge problem for any developer is [LLM API latency](https://taivo.ai/stream/%5F%5Fmaking-gpt-api-responses-faster?ref=taivo.ai). And boy, did OpenAI deliver.

On a quick benchmark I ran:

- gpt-4-1106-preview ("gpt-4-turbo") runs in **18ms/token**
- gpt-3.5-turbo-1106 ("the newest version of gpt-3.5") runs in just **6.5ms/token**

When you put that into context, it's a wild jump:

- gpt-4-turbo is **5x faster** than gpt-4
- gpt-4-turbo is **faster than gpt-3.5 used to be**
- gpt-3.5 is now **3x faster** than June version of gpt-3.5

A bit more detail on the results:

![table of results for recent OpenAI GPT model latencies](https://storage.ghost.io/c/4a/28/4a28c12b-061d-4fef-9be7-3d9f25838589/content/images/2023/11/gpt4_turbo_benchmarks.png)

I'll try to get a proper benchmark up soon, possibly using *Anyscale*'s new [llmperf](https://github.com/ray-project/llmperf?ref=taivo.ai) tool.