4 points | by rndsignals 10 hours ago ago
3 comments
are they though? Since I can't read past the first few paragraphs, but are they testing raw LLMs or the mediated experience of anthropic and openai?
Mediated. The actual research, unlike the nature article is freely available from the authors: https://zou-group.github.io/llm-claims-shelf-life/
So most likely those hallucinations are being squased by some type of real time search somewhere in the system.
are they though? Since I can't read past the first few paragraphs, but are they testing raw LLMs or the mediated experience of anthropic and openai?
Mediated. The actual research, unlike the nature article is freely available from the authors: https://zou-group.github.io/llm-claims-shelf-life/
So most likely those hallucinations are being squased by some type of real time search somewhere in the system.