Hugging Face's logo

opencsg
/
opencsg-CodeLlama-34b-v0.2

Text Generation
Transformers
Safetensors
code
llama
llama-2
text-generation-inference
Model card Files
xet
Community
TomPei commited on
Commit
a9b2418
·
verified ·
1 Parent(s): 00811be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -8
README.md CHANGED
@@ -61,12 +61,12 @@ To simplify the comparison, we chosed the Pass@1 metric for the Python language,
61
  | Model | HumanEval python pass@1 |
62
  | --- |----------------------------------------------------------------------------- |
63
  | CodeLlama-7b-hf | 30.5%|
64
- | opencsg-CodeLlama-7b-v0.1 | **43.9%** |
65
  | CodeLlama-13b-hf | 36.0%|
66
- | opencsg-CodeLlama-13b-v0.1 | **51.2%** |
67
  | CodeLlama-34b-hf | 48.2%|
68
- | opencsg-CodeLlama-34b-v0.1| **56.1%** |
69
- | opencsg-CodeLlama-34b-v0.2| **64.0%** |
70
  | CodeLlama-70b-hf| 53.0% |
71
  | CodeLlama-70b-Instruct-hf| **67.8%** |
72
 
@@ -180,12 +180,12 @@ HumanEval 是评估模型在代码生成方面性能的最常见的基准，尤
180
  | 模型 | HumanEval python pass@1 |
181
  | --- |----------------------------------------------------------------------------- |
182
  | CodeLlama-7b-hf | 30.5%|
183
- | opencsg-CodeLlama-7b-v0.1 | **43.9%** |
184
  | CodeLlama-13b-hf | 36.0%|
185
- | opencsg-CodeLlama-13b-v0.1 | **51.2%** |
186
  | CodeLlama-34b-hf | 48.2%|
187
- | opencsg-CodeLlama-34b-v0.1| **56.1%** |
188
- | opencsg-CodeLlama-34b-v0.2| **64.0%** |
189
  | CodeLlama-70b-hf| 53.0% |
190
  | CodeLlama-70b-Instruct-hf| **67.8%** |
191
 
 
61
  | Model | HumanEval python pass@1 |
62
  | --- |----------------------------------------------------------------------------- |
63
  | CodeLlama-7b-hf | 30.5%|
64
+ | **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
65
  | CodeLlama-13b-hf | 36.0%|
66
+ | **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
67
  | CodeLlama-34b-hf | 48.2%|
68
+ | **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
69
+ | **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
70
  | CodeLlama-70b-hf| 53.0% |
71
  | CodeLlama-70b-Instruct-hf| **67.8%** |
72
 
 
180
  | 模型 | HumanEval python pass@1 |
181
  | --- |----------------------------------------------------------------------------- |
182
  | CodeLlama-7b-hf | 30.5%|
183
+ | **opencsg-CodeLlama-7b-v0.1** | **43.9%** |
184
  | CodeLlama-13b-hf | 36.0%|
185
+ | **opencsg-CodeLlama-13b-v0.1** | **51.2%** |
186
  | CodeLlama-34b-hf | 48.2%|
187
+ | **opencsg-CodeLlama-34b-v0.1**| **56.1%** |
188
+ | **opencsg-CodeLlama-34b-v0.2**| **64.0%** |
189
  | CodeLlama-70b-hf| 53.0% |
190
  | CodeLlama-70b-Instruct-hf| **67.8%** |
191