cs613-embedding-postprocessing / data /compression /stsb_compression_pearson.csv
devansh-lodha's picture
feat: deploy COAST interactive results explorer
464c01b verified
Raw History Blame Contribute Delete
2.72 kB
k,method,google/embeddinggemma-300m,google/embeddinggemma-300m (retention %),Qwen/Qwen3-Embedding-0.6B,Qwen/Qwen3-Embedding-0.6B (retention %),google/gemma-3-1b-pt (mean_pooling),google/gemma-3-1b-pt (mean_pooling) (retention %),google/gemma-3-1b-pt (last_token_pooling),google/gemma-3-1b-pt (last_token_pooling) (retention %),Qwen/Qwen3.5-0.8B-Base (mean_pooling),Qwen/Qwen3.5-0.8B-Base (mean_pooling) (retention %),Qwen/Qwen3.5-0.8B-Base (last_token_pooling),Qwen/Qwen3.5-0.8B-Base (last_token_pooling) (retention %),mean_dedicated_retention_pct,mean_base_mean_retention_pct,mean_base_last_retention_pct
512,prefix,84.44,99.98,84.23,99.97,28.98,84.16,24.92,89.53,42.67,98.33,24.01,92.99,99.98,91.24,91.26
512,pca,84.55,100.11,84.92,100.79,47.75,138.67,43.86,157.56,48.18,111.02,36.61,141.79,100.45,124.85,149.68
512,whitening,82.01,97.1,79.63,94.51,62.12,180.41,64.52,231.81,61.51,141.73,59.92,232.1,95.8,161.07,231.96
512,spectemp,84.95,100.58,85.06,100.96,48.8,141.73,45.15,162.22,48.95,112.8,37.43,144.98,100.77,127.27,153.6
512,coast,85.16,100.82,85.38,101.34,62.21,180.66,64.86,233.01,61.75,142.3,60.32,233.65,101.08,161.48,233.33
256,prefix,84.01,99.47,83.25,98.81,33.88,98.38,19.99,71.82,41.14,94.8,23.43,90.74,99.14,96.59,81.28
256,pca,82.78,98.01,84.57,100.38,46.21,134.21,42.15,151.43,47.11,108.55,35.38,137.04,99.19,121.38,144.23
256,whitening,83.56,98.93,82.85,98.33,61.54,178.72,65.7,236.05,61.67,142.09,60.63,234.83,98.63,160.4,235.44
256,spectemp,84.27,99.78,85.21,101.13,49.22,142.94,46.46,166.91,49.53,114.13,38.35,148.55,100.45,128.54,157.73
256,coast,83.65,99.05,85.18,101.1,61.56,178.79,65.77,236.29,61.69,142.16,60.61,234.75,100.07,160.48,235.52
128,prefix,82.63,97.83,82.69,98.14,45.09,130.96,42.61,153.08,38.57,88.87,28.89,111.88,97.99,109.91,132.48
128,pca,78.94,93.46,83.15,98.69,43.09,125.15,38.8,139.38,44.72,103.05,33.17,128.48,96.07,114.1,133.93
128,whitening,83.41,98.75,84.16,99.89,58.71,170.5,63.72,228.94,59.45,136.98,59.24,229.43,99.32,153.74,229.18
128,spectemp,82.12,97.23,84.86,100.72,48.75,141.57,47.49,170.6,49.75,114.63,39.77,154.03,98.97,128.1,162.32
128,coast,81.03,95.94,84.66,100.48,58.71,170.51,63.74,228.98,59.41,136.89,59.26,229.52,98.21,153.7,229.25
64,prefix,79.47,94.09,80.72,95.81,44.6,129.53,39.49,141.88,33.67,77.58,24.15,93.55,94.95,103.56,117.72
64,pca,73.06,86.5,79.46,94.32,38.94,113.09,34.06,122.38,41.41,95.42,29.89,115.78,90.41,104.26,119.08
64,whitening,80.15,94.9,82.86,98.34,53.26,154.68,58.29,209.42,55.53,127.96,54.42,210.76,96.62,141.32,210.09
64,spectemp,78.38,92.8,82.85,98.34,47.94,139.21,48.3,173.53,50.27,115.83,42.16,163.29,95.57,127.52,168.41
64,coast,76.96,91.12,82.71,98.17,53.33,154.88,58.41,209.86,55.53,127.96,54.36,210.56,94.64,141.42,210.21