--- license: cc-by-nc-sa-4.0 --- SPLADE-Code-8B is a sparse retrieval model designed for code retrieval tasks. ```python from transformers import AutoModelForCausalLM, AutoModel import os import torch splade = AutoModelForCausalLM.from_pretrained("naver/splade-code-8B", trust_remote_code=True) device = (torch.device("cuda") if torch.cuda.is_available() else torch.device("cpu")) splade.to(device) splade.eval() queries = ["SELECT *\nFROM Student\nWHERE Age = (\nSELECT MAX(Age)\nFROM Student\nWHERE Group = 'specific_group'\n)\nAND Group = 'specific_group';"] bow_dict = splade.encode(queries, prompt_type="query", top_k_q=10, return_dict=True, print_dict=True) ``` ``` +--------------------------------------------------------------------+ | TOP ACTIVATED WORDS | +--------------------------------------------------------------------+ * INPUT: SELECT * FROM Student WHERE Age = ( SELECT MAX(Age) FROM Student WHERE Group = 'specific_group' ) AND Group = 'specific_group'; Ġgroup | ████████████████████ 2.34 Ġoldest | ███████████████████ 2.28 Ġage | ███████████████████ 2.25 _group | ███████████████████ 2.25 ĠGroup | ██████████████████ 2.17 ĠAge | ██████████████████ 2.11 ĠMAX | █████████████████ 2.06 ĠStudent | █████████████████ 2.05 Ġspecific | █████████████████ 2.03 Ġstudent | █████████████████ 2.00 ```