GAIA: The LLM Agent Benchmark Everyone’s Talking About
were making headlines last week. In Microsoft’s Build 2025, CEO Satya Nadella introduced the vision of ...
Read moreTag: Benchmark
FACTS Grounding: A new benchmark for evaluating the factuality of large language models
Responsibility & Safety Published 17 December 2024 Authors FACTS team Our comprehensive benchmark and online leaderboard ...
Read more
The Visual Haystacks Benchmark! – The Berkeley Artificial Intelligence Research Blog
Humans excel at processing vast arrays of visual information, a skill that is crucial for achieving ...
Read more
A Case Study with the StrongREJECT Benchmark – The Berkeley Artificial Intelligence Research Blog
When we began studying jailbreak evaluations, we found a fascinating paper claiming that you could jailbreak ...
Read more
ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilities
Recent large language models (LLMs) advancements sparked a growing research interest in tool assisted LLMs solving ...
Read morePremium Content
