Research collection
#benchmark-protocol
Research tagged benchmark-protocol: explanations, evidence, limitations and connections between papers.
2 results
Vulnerability fixes must also keep projects working
VulnBump tests whether coding agents remove dependency vulnerabilities while keeping real projects buildable and passing their tests.
Video scores shift with setup, so Meta-Video records the settings
Meta-Video largely preserves video-model rankings while reducing compute for a stated frame-count sweep across source tests.