a white paper about the topic for the survey platform Verasight, data journalist G. Elliott Morris found, when comparing 1,500 “synthetic” survey respondents and 1,500 real people, that large language models (LLMs) were overall very bad at reflecting the views of actual human respondents
Yeah no shit. Why even do this isn’t the point of a survey to get the opinions of an actual person and how they’re being affected?? Why would a language model stringing word together be comparable.
One inherently flawed aspect of the entire concept, even if LLMs were way better, is that polling is supposed to be a present snapshot of opinion. LLMs are based on inherently older information than the present moment, it cant gauge the current opinion
Yeah no shit. Why even do this isn’t the point of a survey to get the opinions of an actual person and how they’re being affected?? Why would a language model stringing word together be comparable.
One inherently flawed aspect of the entire concept, even if LLMs were way better, is that polling is supposed to be a present snapshot of opinion. LLMs are based on inherently older information than the present moment, it cant gauge the current opinion