ccloud0525 commited on
Commit
561a30d
·
1 Parent(s): fe22a93

feat: 'README'

Browse files
Files changed (2) hide show
  1. README.md +0 -50
  2. docs/figures/FLAME-LOGO.png +0 -0
README.md DELETED
@@ -1,50 +0,0 @@
1
- <div align="center">
2
- <img alt="Logo" src="docs/figures/FLAME-LOGO.png" width="80%"/>
3
- </div>
4
-
5
-
6
-
7
- [![Python](https://img.shields.io/badge/Python-3.10%2B-blue)](https://www.python.org/) [![PyTorch](https://img.shields.io/badge/PyTorch-2.4.1-blue)](https://pytorch.org/)
8
-
9
- # FLAME: Flow Enhanced Legendre Memory Models for General Time Series Forecasting
10
-
11
- This is the official repository of **FLAME**: Flow Enhanced Legendre Memory Models for General Time Series Forecasting.
12
-
13
-
14
-
15
- ## Introduction
16
- FLAME is a family of extremely **lightweight** and highly capable time series foundation models. Based on the normalization-based forecasting head, it can support both the **deterministic** and **probabilistic** forecasting.
17
-
18
- To our best knowldege, FLAME is the first time series foundation model possessing both lightweight backbones and generative prediction capabilities!
19
-
20
-
21
-
22
- <div align="center">
23
- <img alt="pic" src="docs/figures/intro.png" width="80%"/>
24
- </div>
25
-
26
-
27
- ## Architecture
28
-
29
- FLAME adopts the Channel-Independent pretraining paradigm, and each variable is preprocessed through Instance Normalization to mitigate the value discrepancy. FLAME utilizes the Re-Norm to further mitigate the statistical differences between inputs and forecasts, and its backbone mainly consists of three modules: 1) Encoding, including Time Series Tokenization, **Local-Perception**, and MSA-Encoder, which tokenize the time series and enhance them through fusing the local environmental information with LegT; 2) Decoding, including **LegS based SSD-Decoder** and MCA-Enhancer, which utilize the SSD layers and MCA layers to make long-term inference ; 3) **Flow-based Head**, which leverages the Normalization Flow to support generative probabilistic forecasting, with both efficiency and accuracy.
30
-
31
- <div align="center">
32
- <img alt="pic" src="docs/figures/overview.png" width="100%"/>
33
- </div>
34
-
35
-
36
-
37
- ## Quickstart
38
-
39
- You need to install the following packages:
40
-
41
- ```shell
42
- pip install transformers[torch]
43
-
44
- pip install mamba-ssm[causal-conv1d]
45
-
46
- pip install zuko
47
- ```
48
-
49
- For mamba-ssm, there exists a bug about triton. We fix it and release the code at [./flame/mamba/mamba_ssm](./flame/mamba/mamba_ssm), you can compile it from scratch or simply replace the mamba_ssm package under the default path of conda.
50
-
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
docs/figures/FLAME-LOGO.png DELETED
Binary file (94.8 kB)