BAAR Logo

BAAR2-9M

๐ŸŒ Official Website: https://baar.uk/model/
๐Ÿ“„ License: Non-Commercial Only (Contact for Commercial Pricing)


๐Ÿ“Œ Model Overview

BAAR2-9M is an ultra-compact multilingual conversational model designed to enable real-time chat under minimal hardware conditions. With just 9 million (9M) parameters, it brings lightweight, interactive dialogue capabilities across 11 languages to extreme resource-constrained environments, embedded devices, and on-device platforms where standard LLMs cannot operate.

BAAR2-9M์€ ์ตœ์†Œํ•œ์˜ ํ•˜๋“œ์›จ์–ด ์—ฌ๊ฑด๊ณผ ๊ทน๋‹จ์ ์ธ ๋ฆฌ์†Œ์Šค ์ œ์•ฝ ํ™˜๊ฒฝ์—์„œ๋„ 11๊ฐœ ์–ธ์–ด๋กœ ์‹ค์‹œ๊ฐ„ ๋Œ€ํ™”(Chat)๊ฐ€ ๊ฐ€๋Šฅํ•˜๋„๋ก ์„ค๊ณ„๋œ 900๋งŒ(9M) ํŒŒ๋ผ๋ฏธํ„ฐ ๊ทœ๋ชจ์˜ ์ดˆ๊ฒฝ๋Ÿ‰ ๋‹ค๊ตญ์–ด ์–ธ์–ด ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค. ์ผ๋ฐ˜์ ์ธ ๋Œ€ํ˜• ๋ชจ๋ธ ๊ตฌ๋™์ด ๋ถˆ๊ฐ€๋Šฅํ•œ ์ดˆ์ €์‚ฌ์–‘ ์—ฃ์ง€ ๋ฐ ์ž„๋ฒ ๋””๋“œ ๊ธฐ๊ธฐ์—์„œ๋„ ์ฆ‰๊ฐ์ ์ธ ๋Œ€ํ™”ํ˜• ์ถ”๋ก ๊ณผ ์ดˆ๊ฒฝ๋Ÿ‰ ์‹ค์‹œ๊ฐ„ RAG ์‹œ์Šคํ…œ ๊ตฌ์ถ•์„ ์ง€์›ํ•ฉ๋‹ˆ๋‹ค.


๐Ÿ“Š Live Sample Inference

Hardware: Single NVIDIA Tesla T4 | FP16 Inference

Task / Category Prompt Generated Output Latency
ํ•œ๊ตญ์–ด ์ผ๋ฐ˜ QA ๋Œ€ํ•œ๋ฏผ๊ตญ์˜ ์ˆ˜๋„๋Š” ์–ด๋””์ธ๊ฐ€์š”? ๋Œ€ํ•œ๋ฏผ๊ตญ์˜ ์ˆ˜๋„๋Š” 1920๋…„ 6์›” 11์ผ์— ์œ ๋Ÿฝ ~325.2ms
์˜์–ด ์ผ๋ฐ˜ QA What is artificial intelligence? A metal consisting of a metal consisting of a ~314.0ms
์ผ์ƒ์–ด ๋ฒˆ์—ญ ์š”์ฒญ ์•ˆ๋…•์ด ์˜์–ด๋กœ ๋ญ์•ผ? ์•ˆ๋…•์€ ์˜์–ด๋กœ Hello ์ž…๋‹ˆ๋‹ค. ~245.3ms
์ผ์ƒ์–ด ๋ฒˆ์—ญ ์š”์ฒญ 2 ์‚ฌ๊ณผ๊ฐ€ ์˜์–ด๋กœ ๋ญ์•ผ? ์‚ฌ๊ณผ๋Š” ์˜์–ด๋กœ apple ์ž…๋‹ˆ๋‹ค. ~216.1ms
์˜->ํ•œ ๋ฒˆ์—ญ ์š”์ฒญ What is 'Seoul' in Korean? 'Seoul' in Korean is ์„œ์šธ. ~227.6ms
์ผ๋ณธ์–ด ์ผ๋ฐ˜ QA ๆ—ฅๆœฌใฎ้ฆ–้ƒฝใฏใฉใ“ใงใ™ใ‹๏ผŸ ๆ—ฅๆœฌใฎ้ฆ–้ƒฝใฏใ€ ๅคง้˜ชๅธ‚ใซๅ…ฌ็ซ‹ ~325.1ms
์ค‘๊ตญ์–ด ์ผ๋ฐ˜ QA ไบบๅทฅๆ™บ่ƒฝ็š„ไธป่ฆ็‰น็‚นๆ˜ฏไป€ไนˆ๏ผŸ ไบบๅทฅๆ™บ่ƒฝๆ˜ฏไธ€็งๅฏๅ†็”Ÿ่ƒฝๆบ็š„ไธป่ฆ ~348.4ms
์ŠคํŽ˜์ธ์–ด ์ผ๋ฐ˜ QA ยฟCuรกl es la capital de Espaรฑa? Espaรฑa is un capital of medior and el capital ~294.3ms
๋Ÿฌ์‹œ์•„์–ด ์ผ๋ฐ˜ QA ะšะฐะบะฐั ัั‚ะพะปะธั†ะฐ ะ ะพััะธะธ? ะกั‚ะพะปะธั†ะฐ ะ ะพััะธะธ โ€” ัั‚ะพ ะฟั€ะตะดะปะพะถะตะฝะธะต, ะบะพั‚ะพ ~321.3ms
ํžŒ๋””์–ด ์ผ๋ฐ˜ QA เคญเคพเคฐเคค เค•เฅ€ เคฐเคพเคœเคงเคพเคจเฅ€ เค•เฅเคฏเคพ เคนเฅˆ? เคญเคพเคฐเคค เค•เฅ€ เคฐเคพเคœเคงเคพเคจเฅ€ เค•เฅ‡ เคฆเฅŒเคฐเคพเคจ เคญเคพเคฐเคค เค•เฅ‡ เคฌเคพเคฆ เคชเฅเคฐเคพเคฃเฅ€ ~290.9ms

๐Ÿ” Retrieval-Augmented Generation (RAG) Benchmark

This benchmark demonstrates real-time integration between vector retrieval and the BAAR2-9M ultra-lightweight generation model, proving near-instantaneous contextual response generation even with just a 9M parameter footprint.

์‹ค์‹œ๊ฐ„ ๋ฒกํ„ฐ ๊ฒ€์ƒ‰(Retrieval)๊ณผ BAAR2-9M ์ดˆ๊ฒฝ๋Ÿ‰ ์ƒ์„ฑ ์—”์ง„์„ ์—ฐ๋™ํ•œ RAG ํŒŒ์ดํ”„๋ผ์ธ ํ…Œ์ŠคํŠธ ๊ฒฐ๊ณผ์ž…๋‹ˆ๋‹ค. 900๋งŒ ํŒŒ๋ผ๋ฏธํ„ฐ ํฌ๊ธฐ์—์„œ๋„ ์™ธ๋ถ€ ๋ฌธ๋งฅ(Context)์„ ์ „๋‹ฌ๋ฐ›์•„ ์„œ๋ธŒ-์„ธ์ปจ๋“œ(Sub-second) ๋‹จ์œ„์˜ ๊ทน๋‹จ์ ์ธ ๋ฐ˜์‘ ์†๋„๋ฅผ ๋ฐœํœ˜ํ•ฉ๋‹ˆ๋‹ค.

================================================================================
๐Ÿš€ [Starting Real-Time RAG Q&A (BAAR2-9M)]
================================================================================

[1/4] ๐Ÿ‘ค ์งˆ๋ฌธ: ์•„์ดํฐ 16 ํ”„๋กœ ๊ฐ€์žฅ ์‹ผ ๋ชจ๋ธ ์–ผ๋งˆ๋ถ€ํ„ฐ ์‹œ์ž‘ํ•ด?
   ๐Ÿ” ๊ฒ€์ƒ‰ ๋ฌธ์„œ (์œ ์‚ฌ๋„ 0.67 | โฑ๏ธ 79.0ms): "์•„์ดํฐ 16 ํ”„๋กœ๋Š” ํ•ญ๊ณต์šฐ์ฃผ ๋“ฑ๊ธ‰ ํ‹ฐํƒ€๋Š„ ๋””์ž์ธ์œผ๋กœ ์ œ์ž‘๋˜์—ˆ์œผ๋ฉฐ ์ถœ๊ณ ๊ฐ€๋Š” 128GB ๋ชจ๋ธ ๊ธฐ์ค€ 155๋งŒ ์›๋ถ€..."
   ๐Ÿค– AI ๋‹ต๋ณ€: ์ €๋Š” A18 Pro ์นฉ์„ ํƒ‘์žฌํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค. (โฑ๏ธ 298.2ms)
--------------------------------------------------------------------------------

[2/4] ๐Ÿ‘ค ์งˆ๋ฌธ: ์‹ ์ž…์‚ฌ์›์ด ์—ฐ์ฐจ ์“ฐ๋ ค๋ฉด ๋ฉฐ์น  ์ „์— ์Šน์ธ๋ฐ›์•„์•ผ ํ•ด?
   ๐Ÿ” ๊ฒ€์ƒ‰ ๋ฌธ์„œ (์œ ์‚ฌ๋„ 0.79 | โฑ๏ธ 18.1ms): "์‚ฌ๋‚ด ์ทจ์—…๊ทœ์น™ ์ œ18์กฐ์— ๋”ฐ๋ผ ๊ทผ์† 1๋…„ ๋ฏธ๋งŒ ์‹ ๊ทœ ์ž…์‚ฌ์ž๋Š” ๋งค์›” ๊ฐœ๊ทผ ์‹œ 1์ผ์”ฉ ์ด 11์ผ์˜ ์—ฐ์ฐจ๊ฐ€ ๋ถ€์—ฌ๋ฉ..."
   ๐Ÿค– AI ๋‹ต๋ณ€: ์ „ ์„ธ๊ณ„ ์ž…์‚ฌ์›์ด ๋ถ€์„œ์žฅ ์Šน์ธ๋ฐ›์•„์•ผ  (โฑ๏ธ 429.1ms)
--------------------------------------------------------------------------------

[3/4] ๐Ÿ‘ค ์งˆ๋ฌธ: ์ง€๊ตฌ๊ฐ€ ์ž์ „ํ•˜๋Š” ๊ณผํ•™์  ์ด์œ ๊ฐ€ ๋ญ์•ผ?
   ๐Ÿ” ๊ฒ€์ƒ‰ ๋ฌธ์„œ (์œ ์‚ฌ๋„ 0.65 | โฑ๏ธ 16.8ms): "ํƒœ์–‘๊ณ„ ํ˜•์„ฑ ์‹œ๊ธฐ์ธ ์•ฝ 45์–ต ๋…„ ์ „ ๊ฑฐ๋Œ€ํ•œ ๊ฐ€์Šค์™€ ๋จผ์ง€๋กœ ์ด๋ฃจ์–ด์ง„ ์›์‹œ ์„ฑ์šด์ด ์ค‘๋ ฅ์œผ๋กœ ์ˆ˜์ถ•ํ•˜๋ฉด์„œ ๊ฐ์šด๋™๋Ÿ‰..."
   ๐Ÿค– AI ๋‹ต๋ณ€: ๊ฐœ์ธ์ ์œผ๋กœ, ์ด๋Ÿฌํ•œ ์›์‹œ ์„ฑ์šฐ๋™๋Ÿ‰์€ ๊ฐ ๊ณผ (โฑ๏ธ 425.0ms)
--------------------------------------------------------------------------------

[4/4] ๐Ÿ‘ค ์งˆ๋ฌธ: ์ŠคํŽ˜์ธ์˜ ์ˆ˜๋„๋Š” ์–ด๋””์ธ๊ฐ€์š”?
   ๐Ÿ” ๊ฒ€์ƒ‰ ๋ฌธ์„œ (์œ ์‚ฌ๋„ 0.81 | โฑ๏ธ 20.0ms): "์ŠคํŽ˜์ธ์€ ๋‚จ์œ ๋Ÿฝ ์ด๋ฒ ๋ฆฌ์•„๋ฐ˜๋„์— ์œ„์น˜ํ•œ ์ž…ํ—Œ๊ตฐ์ฃผ์ œ ๊ตญ๊ฐ€์ž…๋‹ˆ๋‹ค. ๊ตญํ†  ๋ฉด์ ์€ ์•ฝ 50๋งŒ ์ œ๊ณฑํ‚ฌ๋กœ๋ฏธํ„ฐ์— ๋‹ฌํ•˜๋ฉฐ, ..."
   ๐Ÿค– AI ๋‹ต๋ณ€: ๊ฐœ์ธ์ ์œผ๋กœ, ๊ตญํ†  ๋ฉด์ ์€ ๋‚จ์œ ๋Ÿฝ์˜ ๊ฒฝ์ œ ๋ฐœ (โฑ๏ธ 449.9ms)
--------------------------------------------------------------------------------

๐Ÿ“„ License & Commercial Terms (๋ผ์ด์„ ์Šค ๋ฐ ์ƒ์—…์  ๋„์ž… ์•ˆ๋‚ด)

  • Non-Commercial Use Only (๋น„์ƒ์—…์  ์—ฐ๊ตฌยท๊ฐœ์ธ ์ด์šฉ ํ•œ์ •):
    This model is strictly provided for non-commercial, research, and educational purposes only. Any commercial use without a separate commercial agreement is strictly prohibited.
    ๋ณธ ๋ชจ๋ธ์€ ์ˆœ์ˆ˜ ์—ฐ๊ตฌ, ๊ต์œก ๋ฐ ๊ฐœ์ธ ๋น„์˜๋ฆฌ ๋ชฉ์ ์— ํ•œํ•ด์„œ๋งŒ ๋ฌด๋ฃŒ๋กœ ์ œ๊ณต๋ฉ๋‹ˆ๋‹ค. ์‚ฌ์ „ ํ—ˆ๊ฐ€ ์—†๋Š” ์ผ์ฒด์˜ ์˜๋ฆฌ์  ์ด์šฉ์€ ์—„๊ฒฉํžˆ ๊ธˆ์ง€๋ฉ๋‹ˆ๋‹ค.

  • Commercial Licensing & Inquiries for Revenue-Generating Entities (๋งค์ถœ ๋ฐœ์ƒ ๊ธฐ์—… ๋ฐ ์ƒ์šฉํ™” ๋„์ž… ๋ฌธ์˜):
    If your organization generates revenue, or if you plan to incorporate this model into commercial products, services, or paid APIs, you are required to purchase a commercial license. Please contact us directly via email for enterprise licensing and integration support.
    ๊ธฐ์—…/์‚ฌ์—…์ฒด์— ๋งค์ถœ์ด ๋ฐœ์ƒํ•˜๊ณ  ์žˆ๊ฑฐ๋‚˜, ๋ณธ ๋ชจ๋ธ์„ ์ƒ์šฉ ์„œ๋น„์Šคยท์œ ๋ฃŒ ์ œํ’ˆยท์ˆ˜์ต ์ฐฝ์ถœ ๋ชฉ์ ์˜ ์‹œ์Šคํ…œ์— ๋„์ž…ํ•˜๊ณ ์ž ํ•˜์‹œ๋Š” ๊ฒฝ์šฐ ๋ฐ˜๋“œ์‹œ ๋ณ„๋„์˜ ์ƒ์šฉ ๋ผ์ด์„ ์Šค๋ฅผ ์ทจ๋“ํ•˜์…”์•ผ ํ•ฉ๋‹ˆ๋‹ค. ๋„์ž… ์กฐ๊ฑด ๋ฐ ๊ธฐ์—…์šฉ ๋ผ์ด์„ ์Šค ๋ฐœ๊ธ‰์€ ์•„๋ž˜ ์ด๋ฉ”์ผ๋กœ ๋ฌธ์˜ํ•ด ์ฃผ์‹œ๊ธฐ ๋ฐ”๋ž๋‹ˆ๋‹ค.

    • ๋„์ž… ๋ฐ ์ƒ์šฉ ๋ผ์ด์„ ์Šค ๋ฌธ์˜ (Commercial Inquiries): admin@099.kr
    • ๊ณต์‹ ์›น์‚ฌ์ดํŠธ (Official Website): https://baar.uk/model/

โš ๏ธ Notes (์•ˆ๋‚ด ์‚ฌํ•ญ)

  • Pre-trained Model: This model is a compact base pre-trained checkpoint. For specialized tasks, factual precision, or task completion, task-specific fine-tuning (SFT) or Retrieval-Augmented Generation (RAG) pipelines are recommended.
  • ๊ธฐ์ดˆ ์‚ฌ์ „ํ•™์Šต ๋ชจ๋ธ: ๋ณธ ๋ชจ๋ธ์€ 9M ๊ทœ๋ชจ์˜ ๋ฒ ์ด์Šค ์‚ฌ์ „ํ•™์Šต ์ฒดํฌํฌ์ธํŠธ์ž…๋‹ˆ๋‹ค. ์ •๊ตํ•œ ์ž‘์—… ์ˆ˜ํ–‰, ์‚ฌ์‹ค ๊ด€๊ณ„ ๊ฒ€์ฆ ๋ฐ ์™„์„ฑ๋„ ๋†’์€ ๋Œ€ํ™” ์ƒ์„ฑ์ด ํ•„์š”ํ•œ ๊ฒฝ์šฐ ๋„๋ฉ”์ธ ํŒŒ์ธํŠœ๋‹(SFT) ๋˜๋Š” ๊ฒ€์ƒ‰ ์ฆ๊ฐ• ์ƒ์„ฑ(RAG) ํŒŒ์ดํ”„๋ผ์ธ ๊ฒฐํ•ฉ์„ ๊ถŒ์žฅํ•ฉ๋‹ˆ๋‹ค.

๐Ÿ’ผ Opportunities & Contact (์ฑ„์šฉ ์ œ์•ˆ ๋ฐ ํˆฌ์ž ๋ฌธ์˜)

This project demonstrates practical competency in designing custom micro-scale architectures, end-to-end multi-language pre-training, and ultra-low-latency deployment under extreme compute constraints.

I am actively seeking AI Engineering / Research opportunities, recruitment offers, and technical partnerships.

  • ๊ณต์‹ ์›น์‚ฌ์ดํŠธ (Official Website): https://baar.uk/model/
  • ๊ธฐ์—… ๋„์ž… ๋ฐ ๋ผ์ด์„ ์Šค ๋ฌธ์˜ (Commercial Adoption): admin@099.kr
  • ์ฑ„์šฉ ๋ฐ ํฌ์ง€์…˜ ์ œ์•ˆ (Recruitment & Hiring): admin@099.kr
  • ํˆฌ์ž ๋ฐ ๊ธฐ์ˆ  ํ˜‘๋ ฅ ๋ฌธ์˜ (Investment & Partnerships): admin@099.kr

๊ทน๋‹จ์ ์ธ ์ €์‚ฌ์–‘ ๋ฆฌ์†Œ์Šค ํ™˜๊ฒฝ์—์„œ๋„ ์ฆ‰๊ฐ ์ž‘๋™ํ•˜๋Š” ๊ณ ํšจ์œจ ๋‹ค๊ตญ์–ด ๋ชจ๋ธ ์•„ํ‚คํ…์ฒ˜๋ฅผ ์„ค๊ณ„ํ•˜๊ณ , ๋ฐ์ดํ„ฐ ์ •์ œ๋ถ€ํ„ฐ ํ•™์Šตยท์„œ๋น™๊นŒ์ง€ ์ „ ๊ณผ์ •์„ ์ง์ ‘ ๊ตฌํ˜„ํ•˜๋Š” AI ์—”์ง€๋‹ˆ์–ด์ž…๋‹ˆ๋‹ค. ๊ธฐ์ˆ  ๋„์ž…, ์ฑ„์šฉ ์ œ์•ˆ ๋ฐ ํ˜‘์—…์— ๊ด€์‹ฌ ์žˆ๋Š” ๊ธฐ์—…๊ณผ ํŒ€์˜ ๋ฌธ์˜๋ฅผ ํ™˜์˜ํ•ฉ๋‹ˆ๋‹ค.

Downloads last month
133
Safetensors
Model size
10M params
Tensor type
F16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including aixk/BAAR2-9M