zjudai/flowertune-medical-lora-qwen2.5-7b-instruct

FlowerTune Medical LoRA Model

This is a LoRA adapter for Qwen/Qwen2.5-7B-Instruct fine-tuned with Flower federated learning framework on medical NLP datasets.

Model Performance

• PubMedQA: 0.6515
• MedMCQA: 0.5680
• MedQA: 0.6515
• CareQA: 0.5546
• Average: 0.6064

Training Details

• Domain: Medical
• Training method: Federated LoRA fine-tuning with FlowerTune
• Framework: Flower

This model is a LoRA adapter fine-tuned on Qwen/Qwen2.5-7B-Instruct using the Flower federated learning framework. It was trained on medical NLP datasets through distributed learning. The model achieved scores of PubMedQA: 0.6515, MedMCQA: 0.5680, MedQA: 0.6515, CareQA: 0.5546, with an average score of 0.6064.

Links

• FlowerTune Homepage: https://huggingface.co/zjudai/FlowerTune
• FlowerTune Collection: https://huggingface.co/collections/zjudai/flowertune-lora-collection-67ecd5d0dae6145cbf798439