cs613-embedding-postprocessing / data /compression /fiqa_compression_mrr.csv
devansh-lodha's picture
feat: deploy COAST interactive results explorer
464c01b verified
Raw History Blame Contribute Delete
3.11 kB
k,method,google/embeddinggemma-300m,google/embeddinggemma-300m (retention %),Qwen/Qwen3-Embedding-0.6B,Qwen/Qwen3-Embedding-0.6B (retention %),google/gemma-3-1b-pt (mean_pooling),google/gemma-3-1b-pt (mean_pooling) (retention %),google/gemma-3-1b-pt (last_token_pooling),google/gemma-3-1b-pt (last_token_pooling) (retention %),Qwen/Qwen3.5-0.8B-Base (mean_pooling),Qwen/Qwen3.5-0.8B-Base (mean_pooling) (retention %),Qwen/Qwen3.5-0.8B-Base (last_token_pooling),Qwen/Qwen3.5-0.8B-Base (last_token_pooling) (retention %),mean_dedicated_retention_pct,mean_base_mean_retention_pct,mean_base_last_retention_pct
512,prefix,0.5399,98.7557,0.5519,100.1801,0.0622,88.9402,0.0234,78.135,0.0502,88.5667,0.0031,90.4455,99.4679,88.7534,84.2903
512,pca,0.5419,99.1274,0.5514,100.0797,0.0581,83.0751,0.0297,99.2907,0.05,88.1031,0.0036,105.1583,99.6036,85.5891,102.2245
512,whitening,0.4918,89.9658,0.4934,89.5525,0.1028,146.9146,0.0538,179.8749,0.0647,114.1198,0.0048,140.1817,89.7591,130.5172,160.0283
512,spectemp,0.543,99.3303,0.5519,100.1784,0.0607,86.6779,0.0305,102.1246,0.0517,91.1826,0.0036,105.1583,99.7544,88.9303,103.6414
512,coast,0.545,99.6888,0.5486,99.5693,0.1056,150.9175,0.0553,185.0274,0.0664,117.0442,0.0058,170.34,99.6291,133.9808,177.6837
256,prefix,0.5133,93.9028,0.5348,97.0714,0.0618,88.3757,0.0217,72.765,0.0516,90.9641,0.0035,101.7585,95.4871,89.6699,87.2617
256,pca,0.5152,94.2492,0.545,98.9166,0.0498,71.1521,0.0277,92.7094,0.0418,73.6784,0.0037,107.415,96.5829,72.4153,100.0622
256,whitening,0.5059,92.5445,0.513,93.116,0.0902,128.875,0.0552,184.6929,0.0574,101.167,0.006,174.7948,92.8303,115.021,179.7438
256,spectemp,0.5218,95.4465,0.5473,99.3428,0.0563,80.4856,0.0295,98.7119,0.0441,77.7345,0.0036,105.1583,97.3946,79.1101,101.9351
256,coast,0.5219,95.4712,0.5475,99.3664,0.089,127.2473,0.0565,189.1227,0.0583,102.7993,0.0061,178.5756,97.4188,115.0233,183.8492
128,prefix,0.4667,85.3751,0.5121,92.9428,0.052,74.2819,0.0203,67.8366,0.0315,55.4637,0.0024,68.9625,89.159,64.8728,68.3995
128,pca,0.4824,88.2501,0.5202,94.4225,0.0402,57.4914,0.0218,72.9657,0.0337,59.3488,0.0026,76.143,91.3363,58.4201,74.5544
128,whitening,0.4843,88.5923,0.5105,92.6669,0.0623,89.0759,0.0242,80.989,0.0462,81.4786,0.007,206.1547,90.6296,85.2773,143.5719
128,spectemp,0.4934,90.2544,0.5328,96.7017,0.0493,70.4719,0.0238,79.7109,0.038,67.0539,0.0033,95.4865,93.478,68.7629,87.5987
128,coast,0.5002,91.5093,0.5336,96.8529,0.0603,86.232,0.0241,80.5306,0.048,84.5352,0.0055,161.8113,94.1811,85.3836,121.171
64,prefix,0.3581,65.4989,0.4456,80.8842,0.0363,51.915,0.0113,37.8781,0.0143,25.1617,0.0028,81.9168,73.1916,38.5384,59.8974
64,pca,0.3694,67.5737,0.4706,85.419,0.0261,37.2424,0.0185,61.8275,0.029,51.1608,0.0018,51.6999,76.4963,44.2016,56.7637
64,whitening,0.3862,70.6493,0.4611,83.6878,0.0384,54.8089,0.0189,63.2695,0.0388,68.4641,0.002,58.1477,77.1685,61.6365,60.7086
64,spectemp,0.3862,70.6562,0.4647,84.3416,0.0347,49.6299,0.0197,65.973,0.0355,62.5606,0.0015,45.2227,77.4989,56.0952,55.5979
64,coast,0.4047,74.0324,0.4771,86.5983,0.0399,57.044,0.0198,66.4113,0.041,72.2646,0.0022,64.83,80.3153,64.6543,65.6206