Skip to content

A Benchmark for Visual Question Answering using World Knowledge

A visual question answering benchmark whose questions cannot be answered from the image alone and require commonsense or world knowledge.

1 models

Higher is better.

  1. 1Ternary Bonsai 2 27BPrism ML86.8
Higher is better. Bar colour: blue proprietary, orange open weights, green other.

About this benchmark

Metric
Multiple choice and direct answer
Tasks
Knowledge-grounded visual question answering
Authors
Dustin Schwenk, Apoorv Khandelwal, Christopher Clark, Kenneth Marino, Roozbeh Mottaghi (2022)

Scores are as reported by model developers or evaluators and may use different settings (for example reasoning effort or tools). Compare with care.