whenxuan commited on
Commit
d25713a
·
verified ·
1 Parent(s): 62d1028

whenxuan: update the readme

Browse files
Files changed (1) hide show
  1. README.md +104 -17
README.md CHANGED
@@ -1,17 +1,104 @@
1
- ---
2
- license: apache-2.0
3
- metrics:
4
- - mse
5
- - mae
6
- tags:
7
- - time series
8
- - forecasting
9
- - foundation models
10
- - pretrained models
11
- - generative models
12
- - time series foundation models
13
- library_name: transformers
14
- ---
15
-
16
- # SymTime-NeurIPS2025-Huggingface
17
- The pipeline and model config of SymTime model for Huggingface
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ metrics:
4
+ - mse
5
+ - mae
6
+ tags:
7
+ - time series
8
+ - forecasting
9
+ - foundation models
10
+ - pretrained models
11
+ - generative models
12
+ - time series foundation models
13
+ library_name: transformers
14
+ ---
15
+
16
+ # SymTime NeurIPS 2025
17
+
18
+ This code is the official PyTorch implementation of our NeurIPS'25 paper: **Synthetic Series-Symbol Data Generation for Time Series Foundation Models**.
19
+
20
+ <div align="center">
21
+
22
+ [![NeurIPS](https://img.shields.io/badge/NeurIPS'25-SymTime-orange)](https://neurips.cc/virtual/2025/poster/115260) [![PyPI version](https://badge.fury.io/py/s2generator.svg)](https://pypi.org/project/s2generator/) [![Python](https://img.shields.io/badge/python-3.10+-blue?logo=python)](https://www.python.org/) [![PyTorch](https://img.shields.io/badge/PyTorch-2.0.1-blue)](https://pytorch.org/)
23
+
24
+ [Paper](https://arxiv.org/abs/2510.08445) | [Poster](https://github.com/wwhenxuan/wwhenxuan.github.io/blob/main/assets/img/poster_neurips_2025_115260_synthetic_series-symbol_data_generation.jpg) | [Blog](https://mp.weixin.qq.com/s/D6O5SBl2RYHdkiinV6UM8w) | [Video](https://www.bilibili.com/video/BV1RT4QzXECt/?spm_id_from=333.337.search-card.all.click) | [PPT](https://github.com/wwhenxuan/wwhenxuan.github.io/blob/main/assets/files/NeurIPS_2025_SymTime_video_en.pptx) | [Citation](#Citation) | [HF 🤗](https://huggingface.co/FlowVortex/SymTime)
25
+
26
+ </div>
27
+
28
+ This repository contains the official Hugging Face / PyTorch implementation of **SymTime** from our NeurIPS 2025 paper, *Synthetic Series-Symbol Data Generation for Time Series Foundation Models*.
29
+
30
+ ## Overview
31
+
32
+ SymTime is a lightweight time series foundation model designed to learn strong temporal representations from patch-based inputs. It is built for practical downstream use and supports easy loading through the Hugging Face `AutoModel` interface.
33
+
34
+ <div style="text-align: center;">
35
+ <img src="https://raw.githubusercontent.com/wwhenxuan/SymTime/main/configs/images/S2Generator_SymTime.png" alt="SymTime" style="zoom:80%;" />
36
+ </div>
37
+
38
+ The model takes a univariate time series, splits it into patches, and encodes the patch sequence with a transformer backbone. The repository includes the configuration, model definition, and a runnable example for inference.
39
+
40
+ ## Quick start
41
+
42
+ ### Install dependencies
43
+
44
+ ```bash
45
+ pip install -r requirements.txt
46
+ ```
47
+
48
+ ### Load the model
49
+
50
+ ```python
51
+ from transformers import AutoModel
52
+
53
+ model = AutoModel.from_pretrained("FlowVortex/SymTime", trust_remote_code=True)
54
+ ```
55
+
56
+ ### Run inference
57
+
58
+ ```python
59
+ import torch
60
+
61
+ x = torch.randn(16, 256)
62
+ out = model(x)
63
+ out_no_cls = model(x, return_cls_token=False)
64
+ ```
65
+
66
+ ## Model summary
67
+
68
+ - Input: `Tensor` with shape `[batch_size, seq_length]`
69
+ - Output: patch embeddings, optionally with a CLS token output
70
+ - Backend: patch-based transformer encoder
71
+
72
+ ## Citation <a id="Citation"></a>
73
+
74
+ If you find this code useful, please cite our paper.
75
+
76
+ ```
77
+ @misc{wang2025syntheticseriessymboldatageneration,
78
+ title={Synthetic Series-Symbol Data Generation for Time Series Foundation Models},
79
+ author={Wenxuan Wang and Kai Wu and Yujian Betterest Li and Dan Wang and Xiaoyu Zhang},
80
+ year={2025},
81
+ eprint={2510.08445},
82
+ archivePrefix={arXiv},
83
+ primaryClass={cs.LG},
84
+ url={https://arxiv.org/abs/2510.08445},
85
+ }
86
+ ```
87
+
88
+ ## Contact
89
+
90
+ If you have any questions or are interested in our view on the complex dynamics of time series, feel free to contact:
91
+
92
+ - [Whenxuan Wang](https://wwhenxuan.github.io/) (whenxuanwang@stu.xidian.edu.cn)
93
+ - [Kai Wu](https://sparsel.github.io/index.html) (kwu@xidian.edu.cn)
94
+ - [Dan Wang](https://web.xidian.edu.cn/danwang/) (danwang@xidian.edu.cn)
95
+
96
+ ## Acknowledgement
97
+
98
+ We appreciate the following GitHub repos a lot for their valuable code and efforts.
99
+
100
+ - Time-Series-Library (https://github.com/thuml/Time-Series-Library)
101
+ - PySDKit (https://github.com/wwhenxuan/PySDKit)
102
+ - ALBEF (https://github.com/salesforce/ALBEF)
103
+ - PatchTST (https://github.com/yuqinie98/PatchTST)
104
+ - Short-term Forecasting (https://github.com/ServiceNow/N-BEATS)