Edge-Inference-Benchmarks / data /Parakeet-TDT-0.6B-v3.csv
Magzimilian's picture
Parakeet: correct AGX numbers, add L4 device + peak-memory metric
6657987
Raw
History Blame Contribute Delete
430 Bytes
model_family,model,type,batch,device,res,ctx,lat,ips,mem
Parakeet-TDT-0.6B-v3,nvidia/parakeet-tdt-0.6b-v3,audio,1,agx_orin,N/A,,35.6,28.1,1274
Parakeet-TDT-0.6B-v3,embedl/parakeet-tdt-0.6b-v3-quantized-tensorrt,audio,1,agx_orin,N/A,,34.4,29.1,806
Parakeet-TDT-0.6B-v3,nvidia/parakeet-tdt-0.6b-v3,audio,1,l4,N/A,,16.8,59.4,1280
Parakeet-TDT-0.6B-v3,embedl/parakeet-tdt-0.6b-v3-quantized-tensorrt,audio,1,l4,N/A,,14.6,68.6,862