IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

helcig updated a model about 1 hour ago

ISTA-DASLab/lossless-lm-dev

ionutmodo submitted a paper 6 days ago

DASH: Faster Shampoo via Batched Block Preconditioning and Efficient Inverse-Root Solvers

BlackSamorez authored a paper 10 days ago

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation

View all activity

Papers

DASH: Faster Shampoo via Batched Block Preconditioning and Efficient Inverse-Root Solvers

Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation

View all Papers

ISTA-DASLab 's models 147

ISTA-DASLab/Mistral-7B-v0.1-AQLM-PV-2Bit-1x16-hf

Text Generation • 1B • Updated May 30, 2024 • 1

ISTA-DASLab/SOLAR-10.7B-Instruct-v1.0-GPTQ-4bit

Text Generation • 11B • Updated May 20, 2024 • 2

ISTA-DASLab/Llama-3-8B-Instruct-GPTQ-4bit

Text Generation • 8B • Updated May 16, 2024 • 1

ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16

Text Generation • 11B • Updated May 13, 2024 • 17 • 20

ISTA-DASLab/Phi-3-mini-4k-instruct-AQLM-1x16

Text Generation • 0.7B • Updated May 8, 2024 • 2

ISTA-DASLab/Phi-3-mini-128k-instruct-AQLM-1x16

Text Generation • 0.7B • Updated May 8, 2024 • 2 • 1

ISTA-DASLab/Meta-Llama-3-70B-AQLM-2Bit-1x16

Text Generation • 11B • Updated May 4, 2024 • 8 • 14

ISTA-DASLab/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Apr 23, 2024 • 8

ISTA-DASLab/c4ai-command-r-plus-AQLM-2Bit-1x16

Text Generation • 16B • Updated Apr 21, 2024 • 1 • 10

ISTA-DASLab/Mistral-7B-Instruct-v0.2-AQLM-2Bit-2x8

Text Generation • 2B • Updated Apr 13, 2024 • 65 • 3

ISTA-DASLab/c4ai-command-r-v01-AQLM-2Bit-1x16

Text Generation • 6B • Updated Apr 13, 2024 • 1 • 10

ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf

Text Generation • 1B • Updated Mar 11, 2024 • 15 • 2

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-2x8-hf

Text Generation • 18B • Updated Mar 11, 2024 • 4 • 1

ISTA-DASLab/Llama-2-70b-AQLM-2Bit-1x16-hf

Text Generation • 9B • Updated Mar 11, 2024 • 11 • 6

ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf

Text Generation • 2B • Updated Mar 11, 2024 • 11

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf

Text Generation • 2B • Updated Mar 11, 2024 • 3

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf

Text Generation • 2B • Updated Mar 11, 2024 • 115 • 2

ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf

Text Generation • 1B • Updated Mar 11, 2024 • 69 • 5

ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf

Text Generation • 7B • Updated Mar 11, 2024 • 65 • 23

ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf

Text Generation • 1B • Updated Mar 10, 2024 • 3 • 4

ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf

Text Generation • 0.8B • Updated Mar 10, 2024 • 6

ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf

Text Generation • 7B • Updated Feb 27, 2024 • 10 • 18

ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf

Text Generation • Updated Feb 10, 2024 • 3

ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf

Text Generation • 18B • Updated Feb 10, 2024 • 3

ISTA-DASLab/switch-c-2048_qmoe

Updated Oct 25, 2023 • 4

ISTA-DASLab/switch-large-128_qmoe

Updated Oct 25, 2023 • 4

ISTA-DASLab/switch-base-128_qmoe

Updated Oct 25, 2023 • 4 • 1