Researchers created a benchmark called VPBench, a visually prompted benchmark containing 16 visual marker variants.
Notes on verification
Confirmed directly by arXiv abstract, official GitHub repo, HuggingFace dataset page, and project website, all consistently describing VPBench's 16 visual marker variants.
Sources
- Visually Prompted Benchmarks Are Surprisingly Fragile (arxiv.org)
- https://www.researchgate.net/publication/398937366_Visually_Prompted_Benchmarks_Are_Surprisingly_Fragile (researchgate.net)
- https://lisadunlap.github.io/vpbench/ (lisadunlap.github.io)
- https://github.com/TonyLianLong/VPBench (github.com)
- https://huggingface.co/datasets/longlian/VPBench (huggingface.co)