Want to deploy multiple major AI big models locally on your phone? Today, we bring you a detailed introduction and demo!
Supported models include: DeepSeek R1, Llama 3.3, Qwen 2.5 and Gemma 3. These models not only support Chinese comprehension and generation, but also run smoothly on iOS and Android devices, realizing a true offline intelligence experience.
Taking the open source project PocketPal-AI as an example, we will take you step by step through the installation and configuration process, showing how to use your phone to easily invoke these powerful models for conversations and Q&A. No need to connect to the cloud, protect privacy while dramatically reducing latency, this is a practical solution that AI enthusiasts and developers can't afford to miss!
Deployment is very easy, no setup required, just click your fingers to download and install!
iOS version download: [点击前往]
Download for Android: [点击前往]
APK installation package download: [点击前往], if you are not overseas, choose 👉 [网盘下载]
PocketPal AI
Open Source Project官方仓库]
hallmark
- Offline AI Assist: Run the language model directly on your device without an Internet connection.
- Model Flexibility: Download and exchange between multiple SLMs, including DeepSeek R1, Danube 2 and 3, Phi, Gemma 2, and Qwen.
- Automatic unloading/loading: Memory is automatically managed through an offload model when the application is running in the background.
- inference setting: Customize model parameters such as system prompts, temperatures, BOS tokens, and chat templates.
- Real-time performance indicators: View the number of tokens per second and the number of milliseconds per token during AI response generation.
The latest version of PocketPal AI is now integrated with the Hugging Face Model Hub! It's very easy to browse, download and run models directly from the Hugging Face Hub within the app, and offline AI big models locally on your phone! You can choose the AI model that suits you according to the size of your phone's configuration!
📢 Disclaimer | Tool Use Reminder
1️⃣ The content of this article is based on information known at the time of publication, AI technology and tools are frequently updated, please refer to the latest official instructions.
2️⃣ Recommended tools have been subject to basic screening, but not deep security validation, so please assess the suitability and risk yourself.
3️⃣ When using third-party AI tools, please pay attention to data privacy protection and avoid uploading sensitive information.
4️⃣ This website is not liable for direct/indirect damages due to misuse of the tool, technical failures or content deviations.
5️⃣ Some tools may involve a paid subscription, please make a rational decision, this site does not contain any investment advice.