Alpaca is not as cheap as you think

"Alpaca is just $100 and competitive with InstructGPT" -- takes like this are going around Twitter, adding to the (generally justified!) hype around AI models. It

14 Mar 2023 · 1 min read

Chain-of-thought reasoning

Matt Rickard has a concise overview of Chain-of-thought: the design pattern of having an LLM think step by step. To summarize, the four mentioned approaches from simpler to

13 Mar 2023 · 1 min read

Define a vector space with words

I've been experimenting with embedding ideas into GPT-space, and using the resulting vectors to visualize. For example, you could plot different activities based on two axes:

12 Mar 2023 · 3 min read

AI product overhang

There is a massive AI overhang today. The term is analogous to snow overhang. When snow slides down a roof, sometimes a section goes over the edge and

9 Mar 2023 · 1 min read

Self-driving apps

There's a now-famous classification of different levels of self-driving: * Level 0: No automation * Level 1: Driver assistance * Level 2: Partial automation * Level 3: Conditional automation (human

8 Mar 2023 · 1 min read

Text is the interface, not the use case

Probably 80% of (mainstream, non-ML) Twitter is excited about the potential of GPT and ChatGPT. The other 20% is skeptical. Few are indifferent. But both the optimists and

7 Mar 2023 · 1 min read

Prototyping with GPT API is fun

I've built around 10 prototypes with GPT over the past couple weeks and it's surprisingly fun. Why is that? Obviously it's a

6 Mar 2023 · 1 min read

How do you decompose knowledge work for AI

I hacked a bit on an AI experiment: idea generator. In general, working on these AI apps makes you think a lot about the work process and unique

5 Mar 2023 · 1 min read

AI shovels don't beat AI apps

NFTPort sells tools in web3. I've heard people say that this is a smart approach in a volatile market, because selling shovels in a gold rush

4 Mar 2023 · 1 min read