Upload folder using huggingface_hub

checkpoint-104/README.md

@@ -0,0 +1,209 @@
+---
+base_model: Qwen/Qwen3.5-9B
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:Qwen/Qwen3.5-9B
+- lora
+- sft
+- transformers
+- trl
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.20.0

checkpoint-104/adapter_config.json

@@ -0,0 +1,55 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen3.5-9B",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "monteclora_config": null,
+  "peft_type": "LORA",
+  "peft_version": "0.20.0",
+  "qalora_group_size": 16,
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "in_proj_a",
+    "up_proj",
+    "gate_proj",
+    "o_proj",
+    "in_proj_z",
+    "v_proj",
+    "down_proj",
+    "in_proj_b",
+    "q_proj",
+    "out_proj",
+    "in_proj_qkv",
+    "k_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false,
+  "velora_config": null
+}

checkpoint-104/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa6753b31dec96d00685b7ab64153d0fde1dd543daa00e9783984e5d5950a409
+size 1384975816

checkpoint-104/chat_template.jinja

@@ -0,0 +1,20 @@
+{%- if messages and messages[0].role == 'system' %}
+{{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+{%- set loop_messages = messages[1:] %}
+{%- else %}
+{%- set loop_messages = messages %}
+{%- endif %}
+{%- for message in loop_messages %}
+{{- '<|im_start|>' + message.role + '\n' }}
+{%- if message.role == 'assistant' %}
+{% generation %}{{- message.content + '<|im_end|>' }}{% endgeneration %}{{- '\n' }}
+{%- else %}
+{{- message.content + '<|im_end|>\n' }}
+{%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+{{- '<|im_start|>assistant\n' }}
+{%- if enable_thinking is not defined or not enable_thinking %}
+{{- '<think>\n\n</think>\n\n' }}
+{%- endif %}
+{%- endif %}

checkpoint-104/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:55c8e8b18008a18b6cb854aeb7e1f00e6b7b03d55ff81d7e181f26600a85da28
+size 2770239667

checkpoint-104/rng_state_0.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e0bbdaa7ad33e004283b0d01776956cc110040b5ec0b0baf8b00b8ede32702f
+size 16389

checkpoint-104/rng_state_1.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7f4d0f38aa3e8ca23c960c3fd70659994e21925478e14f43d5321ca118cc1558
+size 16389

checkpoint-104/rng_state_10.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bdfbdb41a021e04dddc7eb7020bbcb000803a73f25966675319c44f7500ce42d
+size 16404

checkpoint-104/rng_state_11.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4a7c2b199a17611a90c335a47e0ccf77962902dceac7d9d93f3464fe11c3fa84
+size 16404

checkpoint-104/rng_state_12.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72be4fcb744c6dad892dd90bbda6cf1862ee86a198c4f9b917e64e06b8085aa9
+size 16404

checkpoint-104/rng_state_13.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d2379532ceeb14dd8bc21fae32b56f9c65643d7d65bf60528cde28c49670043c
+size 16404

checkpoint-104/rng_state_14.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0111c123106e9b277569ece6a3e17cb35c2912fe4dd1a5c7712b57439b60538c
+size 16404

checkpoint-104/rng_state_15.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:30f6d3369632bc73563fdb578571ffba38ad3faede0fec757dd05c8e8c4d3f65
+size 16404

checkpoint-104/rng_state_16.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8e909e38208b01a469a9b9ad466c6101f807da74c6ecfb9e12c3c1328d84ecda
+size 16404

checkpoint-104/rng_state_17.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5c551856e3f9adb4ca8b7d17fbfb4801d25ca075ea6bf8be557e8749ed5a7d33
+size 16404

checkpoint-104/rng_state_18.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:397394cea924c7737ada3d32b5683455bff93fb5f678e9d42ef916b11d664b6e
+size 16404

checkpoint-104/rng_state_19.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cefc617da8c240b5f75d509a8eb01c0598800deee2ccb9270f960f3ad0f342f5
+size 16404

checkpoint-104/rng_state_2.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:045bc8e28d053920b882df35f373069639e7c977bf52252e83faed9bb42fbaa7
+size 16389

checkpoint-104/rng_state_20.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:75a364398ad9de55f6d21863694b831fbab8ba1733b9f8f89b81fc4d474c793e
+size 16404

checkpoint-104/rng_state_21.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6a8047059cd48d386603a9f58ff2768a8897ec22cf8add7ca227d53430c190ba
+size 16404

checkpoint-104/rng_state_22.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3c5db11770cb5dbf972aa6b0962d1fd76f1998be9a1e06644392f69f257c7dc7
+size 16404

checkpoint-104/rng_state_23.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ecb7fad50d99f51b2ae0a77f0829bc441d8ba3077363c1b5c79472c8ca44485e
+size 16404

checkpoint-104/rng_state_24.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:688b48f33fbc0fb75514f86f253c8c3ded2be05711641453c11aed6427d920d2
+size 16404

checkpoint-104/rng_state_25.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b247b3422b27d4c89704430c46923b6fb91057e7a2f3fd7a46e56cb22eb99b0c
+size 16404

checkpoint-104/rng_state_26.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f4aabfb6da1fe1c92858f5d5b850815a7d12204dbf70a584d5dc40e054b89e50
+size 16404

checkpoint-104/rng_state_27.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f433bf58a0aa9ac63247f3d479e7acbcee2539d29e44d15241de61ab8b964962
+size 16404

checkpoint-104/rng_state_28.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:175e7f7fbd8eda83c5a994d6adccb0491d15d4ec5a85cc705548d81353c21352
+size 16404

checkpoint-104/rng_state_29.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af6929bc72e7c8714b885f68c5cfe2e776186a622514670de9fdf19ef7ab612f
+size 16404

checkpoint-104/rng_state_3.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bb5a12e8a7290dba48f099e810aaf2554daedb41defc0e82c4d0413214d0acea
+size 16389

checkpoint-104/rng_state_30.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8192ad22adff0cce9bca03db5c3617e692539b5a2fa65e4064f36f80efed988
+size 16404

checkpoint-104/rng_state_31.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e785ecb4c3798eba0023856d18f4288f60d20e027d4b97fc1a41eb878aad2f4
+size 16404

checkpoint-104/rng_state_4.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:75770e3469400929075cbec9a5e0588b4c6a2ec863a05ca156ee8f02e19dbb4b
+size 16389

checkpoint-104/rng_state_5.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86e96e1e9707de1765595f60cdc00da80bd88bc85e4fe6c8714f8b2481cde86e
+size 16389

checkpoint-104/rng_state_6.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c66e4a9d6fa6e8e021782b28ba7565c192be16231ac013005d79718fde55cf0f
+size 16389

checkpoint-104/rng_state_7.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:be38529aeee864e45e253a61de8546e8c3eb4d9500bc1a8858e9deed04f8d0cb
+size 16389

checkpoint-104/rng_state_8.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:76d82d58882ba2c6dae61a0f562b8e95aa1f0070d7a6378232da6ff2ef5b6657
+size 16389

checkpoint-104/rng_state_9.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20fc0f6c7db9621b61b7ad4bdada1c01530fe818acf7e842750bcb90939a108c
+size 16389

checkpoint-104/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ecff7d040006dcbbb25c876f9fe6f2b9e2dd218c04295b761a5aebaae5c80a6
+size 1465

checkpoint-104/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06b9509352d2af50381ab2247e083b80d32d5c0aba91c272ca9ff729b6a0e523
+size 19989325

checkpoint-104/tokenizer_config.json

@@ -0,0 +1,32 @@
+{
+  "add_prefix_space": false,
+  "audio_bos_token": "<|audio_start|>",
+  "audio_eos_token": "<|audio_end|>",
+  "audio_token": "<|audio_pad|>",
+  "backend": "tokenizers",
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "image_token": "<|image_pad|>",
+  "is_local": false,
+  "local_files_only": false,
+  "model_max_length": 262144,
+  "model_specific_special_tokens": {
+    "audio_bos_token": "<|audio_start|>",
+    "audio_eos_token": "<|audio_end|>",
+    "audio_token": "<|audio_pad|>",
+    "image_token": "<|image_pad|>",
+    "video_token": "<|video_pad|>",
+    "vision_bos_token": "<|vision_start|>",
+    "vision_eos_token": "<|vision_end|>"
+  },
+  "pad_token": "<|endoftext|>",
+  "pretokenize_regex": "(?i:'s|'t|'re|'ve|'m|'ll|'d)|[^\\r\\n\\p{L}\\p{N}]?[\\p{L}\\p{M}]+|\\p{N}| ?[^\\s\\p{L}\\p{M}\\p{N}]+[\\r\\n]*|\\s*[\\r\\n]+|\\s+(?!\\S)|\\s+",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null,
+  "video_token": "<|video_pad|>",
+  "vision_bos_token": "<|vision_start|>",
+  "vision_eos_token": "<|vision_end|>"
+}

checkpoint-104/trainer_state.json

@@ -0,0 +1,234 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.6507936507936507,
+  "eval_steps": 500,
+  "global_step": 104,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "entropy": 0.25798711776733396,
+      "epoch": 0.07936507936507936,
+      "grad_norm": 0.6395628452301025,
+      "learning_rate": 3.3333333333333335e-05,
+      "loss": 0.33170533180236816,
+      "mean_token_accuracy": 0.9083019256591797,
+      "num_tokens": 2249744.0,
+      "step": 5
+    },
+    {
+      "entropy": 0.1518770933151245,
+      "epoch": 0.15873015873015872,
+      "grad_norm": 0.27742329239845276,
+      "learning_rate": 4.9966852247120764e-05,
+      "loss": 0.14515713453292847,
+      "mean_token_accuracy": 0.9476617932319641,
+      "num_tokens": 4502357.0,
+      "step": 10
+    },
+    {
+      "entropy": 0.1205204889178276,
+      "epoch": 0.23809523809523808,
+      "grad_norm": 0.15280286967754364,
+      "learning_rate": 4.976460088644493e-05,
+      "loss": 0.11978392601013184,
+      "mean_token_accuracy": 0.9552689790725708,
+      "num_tokens": 6750630.0,
+      "step": 15
+    },
+    {
+      "entropy": 0.1094709500670433,
+      "epoch": 0.31746031746031744,
+      "grad_norm": 0.13621626794338226,
+      "learning_rate": 4.938000100611456e-05,
+      "loss": 0.10746543407440186,
+      "mean_token_accuracy": 0.9598726153373718,
+      "num_tokens": 8991471.0,
+      "step": 20
+    },
+    {
+      "entropy": 0.10419090241193771,
+      "epoch": 0.3968253968253968,
+      "grad_norm": 0.16320250928401947,
+      "learning_rate": 4.881588452008456e-05,
+      "loss": 0.10661067962646484,
+      "mean_token_accuracy": 0.9599695205688477,
+      "num_tokens": 11228489.0,
+      "step": 25
+    },
+    {
+      "entropy": 0.09569432139396668,
+      "epoch": 0.47619047619047616,
+      "grad_norm": 0.15873780846595764,
+      "learning_rate": 4.80764051721044e-05,
+      "loss": 0.09594419002532958,
+      "mean_token_accuracy": 0.9637031435966492,
+      "num_tokens": 13464387.0,
+      "step": 30
+    },
+    {
+      "entropy": 0.09625398516654968,
+      "epoch": 0.5555555555555556,
+      "grad_norm": 0.15297284722328186,
+      "learning_rate": 4.7167007950568505e-05,
+      "loss": 0.09495124220848083,
+      "mean_token_accuracy": 0.964220929145813,
+      "num_tokens": 15709681.0,
+      "step": 35
+    },
+    {
+      "entropy": 0.09195081293582916,
+      "epoch": 0.6349206349206349,
+      "grad_norm": 0.15219081938266754,
+      "learning_rate": 4.609438899557964e-05,
+      "loss": 0.09150891304016114,
+      "mean_token_accuracy": 0.9652478575706482,
+      "num_tokens": 17987403.0,
+      "step": 40
+    },
+    {
+      "entropy": 0.08980809897184372,
+      "epoch": 0.7142857142857143,
+      "grad_norm": 0.1412411779165268,
+      "learning_rate": 4.4866446293440626e-05,
+      "loss": 0.0898817539215088,
+      "mean_token_accuracy": 0.965602707862854,
+      "num_tokens": 20231746.0,
+      "step": 45
+    },
+    {
+      "entropy": 0.08743101209402085,
+      "epoch": 0.7936507936507936,
+      "grad_norm": 0.16695629060268402,
+      "learning_rate": 4.3492221521624174e-05,
+      "loss": 0.08715485334396363,
+      "mean_token_accuracy": 0.9668790459632873,
+      "num_tokens": 22491762.0,
+      "step": 50
+    },
+    {
+      "entropy": 0.08765677958726883,
+      "epoch": 0.873015873015873,
+      "grad_norm": 0.21143023669719696,
+      "learning_rate": 4.198183347243233e-05,
+      "loss": 0.08766236305236816,
+      "mean_token_accuracy": 0.9668452143669128,
+      "num_tokens": 24752715.0,
+      "step": 55
+    },
+    {
+      "entropy": 0.08127444982528687,
+      "epoch": 0.9523809523809523,
+      "grad_norm": 0.18779045343399048,
+      "learning_rate": 4.03464035455653e-05,
+      "loss": 0.08236484527587891,
+      "mean_token_accuracy": 0.9689654350280762,
+      "num_tokens": 26982538.0,
+      "step": 60
+    },
+    {
+      "entropy": 0.07894417196512223,
+      "epoch": 1.0317460317460316,
+      "grad_norm": 0.1385810822248459,
+      "learning_rate": 3.859797385821812e-05,
+      "loss": 0.0778856873512268,
+      "mean_token_accuracy": 0.9699163198471069,
+      "num_tokens": 29221704.0,
+      "step": 65
+    },
+    {
+      "entropy": 0.07985353171825409,
+      "epoch": 1.1111111111111112,
+      "grad_norm": 0.16439372301101685,
+      "learning_rate": 3.6749418575683e-05,
+      "loss": 0.07885851860046386,
+      "mean_token_accuracy": 0.969633674621582,
+      "num_tokens": 31470338.0,
+      "step": 70
+    },
+    {
+      "entropy": 0.07194689065217971,
+      "epoch": 1.1904761904761905,
+      "grad_norm": 0.16862133145332336,
+      "learning_rate": 3.48143491153543e-05,
+      "loss": 0.074225252866745,
+      "mean_token_accuracy": 0.9716025114059448,
+      "num_tokens": 33719303.0,
+      "step": 75
+    },
+    {
+      "entropy": 0.07757648378610611,
+      "epoch": 1.2698412698412698,
+      "grad_norm": 0.14261098206043243,
+      "learning_rate": 3.280701392214487e-05,
+      "loss": 0.07595503330230713,
+      "mean_token_accuracy": 0.9707554697990417,
+      "num_tokens": 35977913.0,
+      "step": 80
+    },
+    {
+      "entropy": 0.07388863414525985,
+      "epoch": 1.3492063492063493,
+      "grad_norm": 0.16554316878318787,
+      "learning_rate": 3.07421935532949e-05,
+      "loss": 0.07574511766433716,
+      "mean_token_accuracy": 0.9704798936843873,
+      "num_tokens": 38220353.0,
+      "step": 85
+    },
+    {
+      "entropy": 0.07249651849269867,
+      "epoch": 1.4285714285714286,
+      "grad_norm": 0.18186147511005402,
+      "learning_rate": 2.8635091845092247e-05,
+      "loss": 0.07062947750091553,
+      "mean_token_accuracy": 0.9724894285202026,
+      "num_tokens": 40476134.0,
+      "step": 90
+    },
+    {
+      "entropy": 0.06985943019390106,
+      "epoch": 1.507936507936508,
+      "grad_norm": 0.13512398302555084,
+      "learning_rate": 2.650122396287371e-05,
+      "loss": 0.06756666898727418,
+      "mean_token_accuracy": 0.9738536238670349,
+      "num_tokens": 42711931.0,
+      "step": 95
+    },
+    {
+      "entropy": 0.06709291264414788,
+      "epoch": 1.5873015873015874,
+      "grad_norm": 0.13330888748168945,
+      "learning_rate": 2.4356302158625288e-05,
+      "loss": 0.07059981226921082,
+      "mean_token_accuracy": 0.9723513960838318,
+      "num_tokens": 44948562.0,
+      "step": 100
+    }
+  ],
+  "logging_steps": 5,
+  "max_steps": 189,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 3,
+  "save_steps": 8,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 2.606116879537799e+18,
+  "train_batch_size": 4,
+  "trial_name": null,
+  "trial_params": null
+}

checkpoint-104/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:63584b641880ca8f7031099a802ca6e2de6c8e3fdacc7cdffeaa3f69e77b5a9a
+size 5969

checkpoint-112/README.md

@@ -0,0 +1,209 @@
+---
+base_model: Qwen/Qwen3.5-9B
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:Qwen/Qwen3.5-9B
+- lora
+- sft
+- transformers
+- trl
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.20.0

checkpoint-112/adapter_config.json

@@ -0,0 +1,55 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Qwen/Qwen3.5-9B",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 256,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "monteclora_config": null,
+  "peft_type": "LORA",
+  "peft_version": "0.20.0",
+  "qalora_group_size": 16,
+  "r": 128,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "in_proj_a",
+    "up_proj",
+    "gate_proj",
+    "o_proj",
+    "in_proj_z",
+    "v_proj",
+    "down_proj",
+    "in_proj_b",
+    "q_proj",
+    "out_proj",
+    "in_proj_qkv",
+    "k_proj"
+  ],
+  "target_parameters": null,
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false,
+  "velora_config": null
+}

checkpoint-112/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:204917ef911ea1a8fe13bc2ac0e6eaa8d14a83b9c35555e9144f88370a991bf6
+size 1384975816

checkpoint-112/chat_template.jinja

@@ -0,0 +1,20 @@
+{%- if messages and messages[0].role == 'system' %}
+{{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+{%- set loop_messages = messages[1:] %}
+{%- else %}
+{%- set loop_messages = messages %}
+{%- endif %}
+{%- for message in loop_messages %}
+{{- '<|im_start|>' + message.role + '\n' }}
+{%- if message.role == 'assistant' %}
+{% generation %}{{- message.content + '<|im_end|>' }}{% endgeneration %}{{- '\n' }}
+{%- else %}
+{{- message.content + '<|im_end|>\n' }}
+{%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+{{- '<|im_start|>assistant\n' }}
+{%- if enable_thinking is not defined or not enable_thinking %}
+{{- '<think>\n\n</think>\n\n' }}
+{%- endif %}
+{%- endif %}

checkpoint-112/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7d9d02eb8faa93c286245dd87e44f89d7493a04e910ebc9c429e3b2d8c2ab27
+size 2770239667

checkpoint-112/rng_state_0.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:77424b2b07c8e5b4675376c4643d82f3371bb993b555bd752bb639a7096417e4
+size 16389

checkpoint-112/rng_state_1.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:90d46e5d71988eb8f672ba850c534ce412b438a2dd704457d3fa7c8781681ff1
+size 16389

checkpoint-112/rng_state_10.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:beb9ff6df797cee3d03833055235c7db4f02557171346c56f78bfc82a85bd262
+size 16404