GiVA: Gradient-Informed Bases for Vector-Based Adaptation

by [unverified] · free · Last verified 2026-06-16T19:02:10.543Z

As model sizes continue to grow, parameter-efficient fine-tuning has emerged as a powerful alternative to full fine-tuning. While LoRA is widely adopted among these methods, recent research has explored vector-based adaptation methods due to their extreme parameter efficiency. However, these meth...