MobileTransformers: An On-Device LLM PEFT Framework for Fine-Tuning and Generation
MobileTransformers is an Android app and framework for on-device fine-tuning and text generation of large language models (LLMs). Built on ONNX Runtime, it supports fully local fine-tuning, federated learning, generation, tool-calling, quantization, and RAG-based generation, with Huggingface transformer models optimized for mobile and edge devices. Deploy your own small or large language models, create on-device AI agents, fine-tune personalized models from private data, and enable retrieval-augmented generation (RAG).