metadata
pipeline_tag: text-generation
library_name: pytorch bitsandbytes
datasets:
- DLMveloper/DLM_DataSet
language:
- ru
- en
- kk
license: other
license_name: dlm-license
license_link: LICENSE
Model Card for Solade
Model Details
Model Description
Языковая модель на 1.2 миллиардов параметр,
- Developed by: DLMveloper
- Model type: Decoder-only transformer (text generation)
- Language(s): Russian, English, Kazakh
- License: [The license is being examined by lawyers]
Model Sources
- Repository: https://huggingface.co/DLMveloper/Solade (Testing)
Uses
Direct Use
Генерация текста на русском, английском, казахском языках.
Out-of-Scope Use
Модель обучена на ограниченном объёме данных (300 шагов), не предназначена для высокоточных или критичных задач.
Bias, Risks, and Limitations
Модель обучена на небольшом количестве шагов и может выдавать несвязный или некорректный текст.
How to Get Started with the Model
Training Details
Training Data
Датасет: DLMveloper/DLM_DataSet (подвыборка ~20000 примеров)
Training Procedure
Training Hyperparameters
- Training regime: ???????
- Steps: ???
- Batch size: ?
- Learning rate: ?????
- Sequence length: ???.
Speeds, Sizes, Times
- Размер модели: ????? (??-bit quantized)
Technical Specifications
Model Architecture and Objective
- Параметров: ??
- Слоёв: ??
- Hidden size: ????
- Attention heads: ??
- Intermediate size (FFN): ????
- Vocab size: ???
- Компоненты: ???????
Compute Infrastructure
Software
???????????