LLM ENGINEERING / FINE-TUNING
Parameter-Efficient LLM Fine-Tuning for Financial QA
Adapted Qwen2.5-3B-Instruct for financial question answering using QLoRA and 4-bit quantization.
- Built a reproducible FinQA training pipeline with tokenization, gradient accumulation, scheduling and checkpoint recovery.
- Implemented evaluation using Exact Match, Normalized Exact Match and Numerical Accuracy.
- Python
- PyTorch
- Hugging Face Transformers
- PEFT
- Qwen2.5-3B