PEFT Methods

MobileTransformers supports various Parameter-Efficient Fine-Tuning (PEFT) methods for on-device and mobile training.

LoRA (Low-Rank Adaptation)

Documentation coming soon

MARS (Multi-Adapter Rank Sharing)

MARS is a novel PEFT method developed as part of MobileTransformers, created for mobile devices.

Documentation coming soon

Custom PEFT Methods

The framework is extensible and allows implementation of custom PEFT methods.

Documentation coming soon