Frontier LLMs come every 1.5-2 years
I have a theory that the LLM frontier moves every 1.5-2 years. Let me qualify. I mean that a major leap of the whatever is the best
4 Apr 2024 · 1 min read
Explaining quiet quitting
Quiet quitting is a recent name for something I am sure has been happening for all of time. It probably has something to do with the person'
2 Feb 2024 · 2 min read
SAD lights
It seems like everyone I talk to recently is thinking in the same direction: managing their seasonal affective disorder, or SAD. If you live in Estonia, or anywhere
1 Feb 2024 · 2 min read
Strive for off-grid discipline
We lost a floorball game yesterday. I can't stop thinking about it. Maybe because it felt like a pointless loss, like we lost because of something
29 Jan 2024 · 3 min read
Momentum
An object that has a lot of momentum is hard to stop. A bowling ball. An ocean liner. A person who will not allow themselves to be derailed.
29 Jan 2024 · 1 min read
Non-judgemental awareness is curative
Rather than try to fix things, all you have to do is notice, non-judgementally, that you’re doing them. Even while you’re involved in this non-judgemental noticing,
25 Jan 2024 · 1 min read
Curiosity arises from lack of feed
Here's a hypothesis: I think I'll always find something I am curious about. I am a naturally curious person, and I would actually guess
25 Jan 2024 · 2 min read
Are LLMs deterministic?
No. You can see for yourself: setting the temperature variable to 0 (meaning you always sample the most likely token from the output distribution), you'd expect
23 Jan 2024 · 2 min read
Recent LLM launches, and LLM rumors
Llama 3 is already training according to Zuck. There are conflicting sources & rumors, and the release date claims vary across all of 2024. For GPT-5 there are
23 Jan 2024 · 1 min read
A wild speed-up from OpenAI Dev Day
I'll share more thoughts on OpenAI Dev Day announcements soon, but one huge problem for any developer is LLM API latency. And boy, did OpenAI deliver.
7 Nov 2023 · 1 min read