Colin's avatar

Colin

@colin-fraser.net

What we care about from an LLM chat bot is the truth of the propositions that *emerge* out of the combination of a whole bunch of distinct predictions, each of which having no well-defined notion of right or wrong.

1 replies 0 reposts 1 likes


Colin's avatar Colin @colin-fraser.net
[ View ]

What you're really asking the LLM to do when you ask it to generate text is to pretend that the text exists and set it to work reconstructing the pretend text. That sounds very much like what you're asking it to do is to hallucinate.

1 replies 1 reposts 5 likes