piuzha commited on
Commit
2e68ff0
·
verified ·
1 Parent(s): 6ceeeb1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md CHANGED
@@ -114,6 +114,21 @@ The released repository's default configs evaluate SACTOR's interface-preserving
114
  Generated code may therefore contain raw pointers or `unsafe` Rust. Passing the benchmark measures
115
  agreement on the supplied test suite, not formal semantic equivalence.
116
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
117
  ## Resources
118
 
119
  - [Benchmark, evaluation harness, and setup instructions](https://github.com/moxin-org/C2Rust)
 
114
  Generated code may therefore contain raw pointers or `unsafe` Rust. Passing the benchmark measures
115
  agreement on the supplied test suite, not formal semantic equivalence.
116
 
117
+
118
+ ## Evaluation results
119
+
120
+ | name | model size | accuracy |
121
+ |-----------------|------------|----------|
122
+ | Qwen3.5-plus | 397B | 77.20% |
123
+ | MiniMax-M2.5 | 230B | 83.90% |
124
+ | GLM-5 | 744B | 84.40% |
125
+ | GLM-5.2 | 744B | 89.90% |
126
+ | Claude Code-4.6 | | 90.01% |
127
+ | Qwen3.5 | 27B | 72.30% |
128
+ | Ours | 27B | 87.20% |
129
+
130
+
131
+
132
  ## Resources
133
 
134
  - [Benchmark, evaluation harness, and setup instructions](https://github.com/moxin-org/C2Rust)