MetaCore-LLM commited on
Commit
4602def
·
verified ·
1 Parent(s): 8de6aa2

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -0
README.md ADDED
@@ -0,0 +1,30 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - ru
4
+ license: mit
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - russian
9
+ - llama
10
+ - causal-lm
11
+ - continued-pretraining
12
+ - cpt
13
+ - tiny
14
+ base_model: MetaCore-LLM/MetaCore-1-Test-Base
15
+ model-index:
16
+ - name: MetaCore-1-Test-CPT
17
+ results: []
18
+ ---
19
+
20
+ # MetaCore-1-Test-CPT
21
+
22
+ **MetaCore-1-Test-CPT** is a lightweight Russian language model obtained by **continued pre‑training (CPT)** the base model [`MetaCore-1-Test-Base`](https://huggingface.co/MetaCore-LLM/MetaCore-1-Test-Base) on a broader and more diverse Russian text corpus.
23
+ This model serves as an intermediate checkpoint, offering improved language understanding over the base model, and is intended to be further fine‑tuned for specific downstream tasks (e.g., instruction tuning, classification).
24
+
25
+ - **Developer:** MetaCore-LLM
26
+ - **Architecture:** Custom LLaMA-style (tiny config)
27
+ - **Language:** Russian
28
+ - **Parameter count:** ~16.2 million
29
+
30
+ ---