YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

ollai-stack-0_1B (Transformers)

Purpose

  • Daily conversation model
  • Non-coding assistant behavior

Architecture

  • Custom architecture: OllaiForCausalLM

  • hidden_size: 768

  • intermediate_size: 3072

  • layers: 8

  • heads: 12

  • kv_heads: 6

  • max_seq_len: 128

  • rope_theta: 10000

  • qk_norm: True

  • local_mixer: True

  • neftune_alpha: 0.0

Downloads last month
-
Safetensors
Model size
0.1B params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support