| --- |
| title: README |
| emoji: 🚀 |
| colorFrom: pink |
| colorTo: indigo |
| sdk: static |
| pinned: false |
| --- |
| |
|
|
| # Spatial9 Inc. |
|
|
|
|
| ## Generative Spatial Audio™ |
|
|
| Spatial9 is an artificial intelligence company pioneering **Generative Spatial Audio™**, a new paradigm where AI systems understand Audio and automatically generate immersive spatial sound environments. |
|
|
| Our mission is to enable creators, developers, and platforms to transform traditional audio into **interactive and immersive spatial experiences** using AI. |
|
|
| Demo at **[https://spatial9.ai/demo](https://spatial9.ai/demo)** |
|
|
| --- |
|
|
| # What is Generative Spatial Audio |
|
|
| Generative Spatial Audio is the capability for AI systems to: |
|
|
| * Understand musical structure and sonic roles |
| * Detect instruments and acoustic layers |
| * Place sounds in three-dimensional environments |
| * Generate spatial movement and interaction |
| * Adapt mixes to immersive playback formats automatically |
|
|
| Instead of manually mixing spatial audio objects, **AI becomes the spatial mixer**. |
|
|
| This allows creators to convert stereo music, video audio, and stems into **immersive spatial scenes in seconds**. |
|
|
| --- |
|
|
| # Core Technologies |
|
|
| ## GravityLLM |
|
|
| GravityLLM is the world's first **Spatial Audio Language Model (SLM)**. |
|
|
| GravityLLM understands musical structure, instruments, and acoustic constraints to automatically generate spatial audio scenes. |
|
|
| ### Capabilities |
|
|
| * AI-driven spatial object placement |
| * Music-aware positioning and motion |
| * Automatic immersive mixing |
| * Scene generation for immersive audio formats |
|
|
| GravityLLM converts: |
|
|
| ``` |
| music + constraints → spatial audio scene |
| ``` |
|
|
| Example output: |
|
|
| ```json |
| { |
| "scene": { |
| "layout": "7.1.4", |
| "objects": [ |
| { "class": "lead_vocal", "az": 0, "el": 10, "distance": 1.5 }, |
| { "class": "pad", "az": -70, "el": 20, "distance": 4 }, |
| { "class": "fx", "az": 110, "el": 30, "distance": 6 } |
| ] |
| } |
| } |
| ``` |
|
|
| --- |
|
|
| ## Spatializer API |
|
|
| The Spatializer API enables developers to convert audio into immersive spatial sound programmatically. |
|
|
| ### Features |
|
|
| * Stereo to spatial audio conversion |
| * Video spatialization |
| * Interactive sound environments |
| * Real-time immersive audio generation |
|
|
| --- |
|
|
| ## Eclipsa Audio Pipeline |
|
|
| Spatial9 provides tools for producing immersive audio compatible with **YouTube's Eclipsa Audio ecosystem**, enabling immersive audio distribution at scale. |
|
|
| --- |
|
|
| # Models on Hugging Face |
|
|
| The Spatial9 Hugging Face ecosystem includes models for: |
|
|
|
|
| ### GravityLLM |
|
|
| The Spatial Audio Language Model responsible for generating **Spatial9Scene layouts**. |
|
|
| --- |
|
|
| # Use Cases |
|
|
| ## Music Production |
|
|
| Convert stereo music into immersive spatial mixes automatically. |
|
|
| ## Video Spatialization |
|
|
| Spatialize video audio for immersive playback platforms. |
|
|
| ## XR and Gaming |
|
|
| Generate dynamic spatial sound environments for interactive media. |
|
|
| ## Creator Tools |
|
|
| Enable creators to produce immersive audio without complex spatial mixing workflows. |
|
|
| --- |
|
|
| # Vision |
|
|
| The future of audio will be **interactive, spatial, and intelligent**. |
|
|
| Spatial9 is building the AI foundation that will power: |
|
|
| * immersive music |
| * spatial video |
| * XR audio environments |
| * adaptive sound experiences |
|
|
| Generative Spatial Audio represents a new generation of sound creation and distribution. |
|
|
| --- |
|
|
| # Open Ecosystem |
|
|
| Spatial9 believes immersive audio should be **accessible and scalable**. |
|
|
| We are building open models, APIs, and developer tools that allow anyone to create immersive sound experiences. |
|
|
| --- |
|
|
| # Links |
|
|
| Website |
| [https://spatial9.ai](https://spatial9.ai) |
|
|
|
|
| Hugging Face |
| [https://huggingface.co/spatial9](https://huggingface.co/spatial9) |
|
|
| --- |
|
|
| # Spatial9 |
|
|
| Generative Spatial Audio™ |
|
|
| AI systems that understand music and generate immersive spatial sound. |
|
|
| GravityLLM • Spatializer API • Immersive AI |
