|
Colin@colin-fraser.net |
This assumption is in fact trivially false: for example it can't output a million decimal digits of π. Generate AI systems rely on guessing the next token, and there's just no way to make a million correct guesses in a row.
1 replies 0 reposts 2 likes
|
|
Colin
@colin-fraser.net
[ View ] |
Generating a million digits of π is not inherently that useful of a task, but I argue that many tasks are more similar that you think to generating million digits of π, in the sense that in order to do them right it's crucial to generate the right tokens in the right order.
1 replies 0 reposts 3 likes