1 result

for peft

• LoRA: freeze the weights, train a low-rank correction
  Low-Rank Adaptation, introduced 2021 by Microsoft researchers, is the dominant parameter-efficient fine-tuning technique: instead of updating every weight of a pretrained model, freeze the pretrained
  field/lora-low-rank-adaptation · lora, fine-tuning, peft, training, llm