ProgramBench

programbench's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

john-b-yang 

authored a paper 6 months ago

CodeClash: Benchmarking Goal-Oriented Software Engineering

Paper • 2511.00839 • Published Nov 2, 2025 • 10

john-b-yang 

authored 7 papers 12 months ago

SWE-smith: Scaling Data for Software Engineering Agents

Paper • 2504.21798 • Published Apr 30, 2025 • 15

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Paper • 2310.06770 • Published Oct 10, 2023 • 9

InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback

Paper • 2306.14898 • Published Jun 26, 2023

DevBench: A Comprehensive Benchmark for Software Development

Paper • 2403.08604 • Published Mar 13, 2024 • 2

WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents

Paper • 2207.01206 • Published Jul 4, 2022 • 3

SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering

Paper • 2405.15793 • Published May 6, 2024 • 7

MMTEB: Massive Multilingual Text Embedding Benchmark

Paper • 2502.13595 • Published Feb 19, 2025 • 48