Instruction finetuning small open LLMs (Alpaca, FLAN-T5) boosts mental-health prediction to match or beat much larger models
Finetuning small open LLMs on a variety of labeled mental-health texts can yield classifiers that match or beat much larger models, reducing inference cost and vendor dependence while preserving multi-task flexibility.
Key finding
Instruction finetuning markedly improves performance over prompting.
Numbers: Alpaca finetuned: +23.4% balanced accuracy vs Alpaca zero-shot

