|
Andrew Mercer@awmercer.bsky.social |
The issue as I see it is that you could never know if a study done using simulated research subjects generalizes to human subjects without doing the human study to compare. At which point why bother doing the AI study in the first place?
3 replies 12 reposts 44 likes
|
E-W
@edashw.bsky.social
[ View ] |
Can you learn things by mulching the internet into a massive LLM and then testing a ton of discrete values against actual observation (ie election day)? Yeah, probably. Will it be what you expect? Almost certainly not. Is it gonna be an artifact of the data cleaning? Yup. Is this polling? clearly no
0 replies 0 reposts 0 likes
|
Frank Lynch
@fplynch.bsky.social
[ View ] |
Test of concept. Admittedly tough to generalize to others, but I'm sure there are firms who would love to make the sales.
0 replies 0 reposts 0 likes
|
|
Andrew Mercer
@awmercer.bsky.social
[ View ] |
To get to the point where we could be confident that AI systems are reliably generating generalizable people would require strong theory and knowledge about what humans do and why, and how exactly AI reproduces that behavior. In which case, why are we studying this at all?
1 replies 0 reposts 11 likes