| --- |
| license: apache-2.0 |
| language: |
| - en |
| base_model: |
| - Qwen/Qwen2.5-Coder-0.5B |
| pipeline_tag: text-generation |
| datasets: |
| - seniruk/git-diff_to_commit_msg_large |
| --- |
| |
| # Hi, I’m Seniru Epasinghe 👋 |
|
|
| I’m an AI undergraduate and an AI enthusiast, working on machine learning projects and open-source contributions. |
| I enjoy exploring AI pipelines, natural language processing, and building tools that make development easier. |
|
|
| --- |
|
|
| ## 🌐 Connect with me |
|
|
| [](https://huggingface.co/seniruk) |
| [](https://medium.com/@senirukepasinghe) |
| [](https://www.linkedin.com/in/seniru-epasinghe-b34b86232/) |
| [](https://github.com/seth2k2) |
|
|
|
|
| ### Finetuned-qwen2.5-coder-0.5B model on 100000 rows of a cutom dataset containing. git-differences and respective commit messages |
| - [dataset huggingface link](https://huggingface.co/datasets/seniruk/git-diff_to_commit_msg_large) |
| - [dataset kaggle link](https://www.kaggle.com/datasets/seniruepasinghe/git-diff-to-commit-msg-large) |
|
|
| ### Each row of the dataset was formatted as below to suit finetuning requirement of Qwen2.5-coder model so we have to use the same prompt for better results |
| ``` |
| """Generate a concise and meaningful commit message based on the provided Git diff. |
| |
| ### Git Diff: |
| {Git diff from dataset} |
| |
| ### Commit Message:""" |
| ``` |
|
|
| ### Code for inference of the gguf model is given below |
|
|
| ``` |
| from llama_cpp import Llama |
| |
| modelGGUF = Llama.from_pretrained( |
| repo_id="seniruk/qwen2.5coder-0.5B_commit_msg", |
| filename="qwen0.5-finetuned.gguf", |
| rope_scaling={"type": "linear", "factor": 2.0}, |
| chat_format=None, # Disables any chat formatting |
| n_ctx=32768, # Set the context size explicitly |
| ) |
| |
| # Define the commit message prompt (Minimal format, avoids assistant behavior) |
| commit_prompt = """Generate a meaningful commit message explaining all the changes in the provided Git diff. |
| |
| ### Git Diff: |
| {} |
| |
| ### Commit Message:""" # Removed {} after "Commit Message:" to prevent pre-filled text. |
| |
| # Git diff example for commit message generation |
| git_diff_example = """ |
| diff --git a/index.html b/index.html |
| index 89abcde..f123456 100644 |
| --- a/index.html |
| +++ b/index.html |
| @@ -5,16 +5,6 @@ <body> |
| <h1>Welcome to My Page</h1> |
| |
| - <table border="1"> |
| - <tr> |
| - <th>Name</th> |
| - <th>Age</th> |
| - </tr> |
| - <tr> |
| - <td>John Doe</td> |
| - <td>30</td> |
| - </tr> |
| - </table> |
| |
| + <p>This is a newly added paragraph replacing the table.</p> |
| </body> |
| </html> |
| """ |
| |
| # Prepare the raw input prompt |
| input_prompt = commit_prompt.format(git_diff_example) |
| |
| # Generate commit message |
| output = modelGGUF( |
| input_prompt, |
| max_tokens=64, |
| temperature=0.6, # Balanced randomness |
| top_p=0.8, # Controls nucleus sampling |
| top_k=50, # Limits vocabulary selection |
| ) |
| |
| # Decode and print the output |
| commit_message = output["choices"][0]["text"].strip() |
| |
| print("\nGenerated Commit Message:\n{}".format(commit_message)) |
| ``` |
