4 2 19

Yisel Clavel Quintero

clavel

AI & ML interests

machine learning, NLP, NLU

Recent Activity

liked a model 2 days ago

gia-uh/cecilia-2b-instruct-v1

liked a model about 1 year ago

distilbert/distilbert-base-uncased-finetuned-sst-2-english

liked a model about 1 year ago

cardiffnlp/twitter-roberta-base-irony

View all activity

Organizations

liked a model 2 days ago

gia-uh/cecilia-2b-instruct-v1

Text Generation • 2B • Updated Nov 29, 2025 • 281 • 7

liked 5 models about 1 year ago

liked a Space about 1 year ago

Exbert

🌍

176

Explore BERT model's attention mechanisms

reacted to macadeliccc's post with 👍 about 2 years ago

Post

4627

Fine tune Phi-3 using samatha themed dataset and Huggingface SFT trainer!

In this colab, we simply apply a supervised finetune to phi-3 using the sharegpt format.

def formatting_prompts_func(examples):
    convos = examples["conversations"]
    texts = []
    mapper = {"system": "system\n", "human": "\nuser\n", "gpt": "\nassistant\n"}
    end_mapper = {"system": "", "human": "", "gpt": ""}
    for convo in convos:
        text = "".join(f"{mapper[(turn := x['from'])]} {x['value']}\n{end_mapper[turn]}" for x in convo)
        texts.append(f"{text}{EOS_TOKEN}")  
    return {"text": texts}

dataset = dataset.map(formatting_prompts_func, batched=True)
print(dataset['text'][8])

Opus Samantha consists of 1848 samples with the samantha personality. The dataset covers a wide variety of topics such as logical reasoning, mathematics, legal, and rp.

This notebook serves as a viable option to finetune Phi-3 until Unsloth supports phi-3, which should be very soon. When that happens check out AutoSloth for both SFT, DPO, and langfuse format RAG fine tuning on free tier colab hardware.

Resources:
Dataset: macadeliccc/opus_samantha
Colab: https://colab.research.google.com/drive/1e8LILflDQ2Me52hwS7uIfuJ9DxE2oQzM?usp=sharing
AutoSloth: https://colab.research.google.com/drive/1Zo0sVEb2lqdsUm9dy2PTzGySxdF9CNkc#scrollTo=bpimlPXVz-CZ