Fixed compiling issue, added legnth penalty, and atttempting freezing encoder layers 0-5 to lower parameters and preserve T5's langauge understanding. baf3026 OliverPerrin commited on Jan 14
Update LexiMind: improved training, model architecture, and evaluation 076bc18 OliverPerrin commited on Dec 7, 2025
Fix Pylance type errors, add inductor compilation support cf79a6c OliverPerrin commited on Dec 5, 2025
feat: Add FLAN-T5 compatibility with relative position bias 486475d OliverPerrin commited on Dec 4, 2025
Refactor: Consolidate dependencies, improve testing, and add CI/CD f6d689c OliverPerrin commited on Dec 3, 2025
Finsihed Decoder Implementation, as well as prediction heads and multitask f672f40 OliverPerrin commited on Oct 29, 2025
Implemented the following parts for the Transformer model: poisional_encoding, feedfoward, encoder, and skeleton of decoder. As well as Test cases for each class respectively and visualizations aefdcf0 OliverPerrin commited on Oct 29, 2025
Implemented ScaledDotProduct Attention and Multi-Head Attention 046d0f2 OliverPerrin commited on Oct 27, 2025