| | --- |
| | license: mit |
| | tags: |
| | - code |
| | widget: |
| | - text: "print(" |
| | example_title: "Example 1" |
| | - text: "def calculate" |
| | example_title: "Example 2" |
| | --- |
| | ```Complexity-1B``` |
| |
|
| | # Model Details |
| | Complexity-1B is a finetuned version of the GPT-NeoX 1.3B model [@gpt-neox] for code completion tasks. It was finetuned on a dataset of Python code from open source projects on GitHub. |
| |
|
| | # Intended Uses |
| | This model is intended to be used for code completion in Python. It can suggest likely completions for partially written Python code. |
| |
|
| | # Evaluation Data |
| | The model was evaluated on a holdout set from the training data distribution, containing Python code snippets. |
| |
|
| | # Metrics |
| | The primary evaluation metric was accuracy of code completion on the evaluation set. The model achieves 49% accuracy on code completion. |
| |
|
| | # Ethical Considerations |
| | The training data contains code from public GitHub repositories. Care should be taken to avoid completing code in unethical or harmful ways not intended by the original developers. |
| |
|
| | # Caveats and Recommendations |
| | The model is designed for Python code completion only. Performance on other programming languages is unknown. Users should carefully validate any generated code before executing or deploying it. |
