Edge-Inference-Benchmarks / data /paraphrase-multilingual-MiniLM-L12-v2.csv
Magzimilian's picture
Add deploy-benchmark model families (8 models, lat/ips/mem metrics)
45c0521
Raw
History Blame Contribute Delete
326 Bytes
model_family,model,type,batch,device,res,ctx,lat,ips,mem
paraphrase-multilingual-MiniLM-L12-v2,sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2,text,1,agx_orin,N/A,,0.775,1290,224
paraphrase-multilingual-MiniLM-L12-v2,embedl/paraphrase-multilingual-MiniLM-L12-v2-quantized-trt,text,1,agx_orin,N/A,,0.73,1369,211