Use this model

!pip install -q --upgrade bitsandbytes transformers accelerate

from transformers import pipeline

pipe = pipeline("text-generation", model="alanjoshua2005/alan-mistral-finetuned")

user_input = input("Enter your medical question or prompt: ")

prompt = (
    f"""Imagine you are a helpful medical chatbot. Respond based on the user input below:

<s>[INST] {user_input} [/INST]

Please provide your answer in **structured Markdown format**. Follow these rules:
- Complete the answer fully; do not stop mid-sentence
- Use emojis to highlight key points
- Use horizontal lines (---) to separate sections
- Use bullet points and numbered lists where appropriate
- Use tables if necessary to organize information clearly
- Explain medical terms in simple words
- Do NOT include any links, URLs, or image references
- Make the response easy-to-read and informative
"""
)

result = pipe(
    prompt,
    max_new_tokens=512,       
    do_sample=True,
    temperature=0.7,
    top_p=0.9,
    repetition_penalty=1.1    
)

generated_text = result[0]["generated_text"]
response = generated_text.replace(prompt, "").strip()

print(response)

Model Details

  • Developed by: Alan Joshua
  • Model type: Text-Generation
  • Language(s): English
  • License: MIT
  • Finetuned from model: unsloth/mistral-7b-instruct-v0.2-bnb-4bit
  • Dataset: ruslanmv/ai-medical-chatbot

Model Description

This model is a medical chatbot fine-tuned on the ruslanmv/ai-medical-chatbot dataset using LoRA adapters on the Mistral 7B instruct model (4-bit). It is designed to provide accurate, easy-to-understand medical information in English.

Key features of this model include:

  • Structured Markdown responses: Answers are formatted using bullets, numbered lists, tables, and horizontal lines for readability.
  • Clear explanations: Medical terms are explained in simple words for users of all backgrounds.
  • Emojis: Used to highlight key points and make responses more engaging.
  • No links or images: Ensures responses remain text-only for safe, direct answers.
  • Complete answers: Designed to generate full, coherent responses without cutting off mid-sentence.

This model is suitable for educational purposes, healthcare awareness, and interactive Q&A applications. It is not a substitute for professional medical advice. Always verify information with a qualified healthcare provider.

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for CloveAI/clov-medchat

Adapter
(50)
this model