File size: 674 Bytes
24cf163
 
62970d7
 
 
24cf163
 
 
 
194028a
62970d7
194028a
 
62970d7
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
---
title: README
emoji: 🦊
colorFrom: yellow
colorTo: red
sdk: static
pinned: false
---

# ProgramBench: Can Language Models Rebuild Programs From Scratch?

Given only a compiled binary and its documentation, AI agents must architect and implement a complete codebase that reproduces the original program's behavior.
ProgramBench evaluates this capability across 200 real-world open-source projects spanning Rust, Go, C, C++, Haskell, and Java.

## Links

- [Website & Leaderboard](https://programbench.com)
- [Paper](https://programbench.com/static/paper.pdf)
- [GitHub](https://github.com/facebookresearch/ProgramBench)
- [Documentation](https://programbench.com/more)