Asghar Ghorbani

One of PocketPal's longest-standing open requests is finally closed:
🎉 𝗶𝗣𝗮𝗱 support is here! 🎉

Huge shoutout to Sultan Qasim (github.com/sultanqasim) for the contribution.

Feel free to give it a spin: apps.apple.com/us/app/pocke...

#PocketPalAI

Make you own Pal:

GitHub - a-ghorbani/pocketpal-ai: An app that brings language models directly to your phone. An app that brings language models directly to your phone. - a-ghorbani/pocketpal-ai

Grab the latest version here:
𝗶𝗢𝗦: apps.apple.com/app/pocketpa...
𝗔𝗻𝗱𝗿𝗼𝗶𝗱: play.google.com/store/apps/d...

And if you're into poking around the code, hear is the source code: github.com/a-ghorbani/pocketpal-ai

What Pals are you cooking up?

Let me know how it vibes!
Now it is your turn to mess around and stuff your pocket with as many 𝗣𝗮𝗹𝘀 as you can :)

#PocketPal #PocketPalAI #LLM #LocalLLM #ondevicellm

Just shipped 𝗣𝗮𝗹𝘀 in PocketPal (v1.8.3+) 🚀🚀🚀

It's a chill way to handle system prompts and LLM setups. Think 𝘛𝘳𝘢𝘯𝘴𝘭𝘢𝘵𝘰𝘳 𝘗𝘢𝘭 or 𝘙𝘰𝘭𝘦𝘱𝘭𝘢𝘺 𝘗𝘢𝘭 etc. You can even use any of the on device LLM (like Llama 3.2 3B) to craft prompts for you.

This is the spirit we need to keep rolling

GitHub - huggingface/open-r1: Fully open reproduction of DeepSeek-R1 Fully open reproduction of DeepSeek-R1. Contribute to huggingface/open-r1 development by creating an account on GitHub.

We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open!

Follow along: github.com/huggingface/...

Hey

So cute. Lots of treats, training, and stochastic gradient decent

PocketPal AI :)

🚀 PocketPal AI 1.6.2 is released with an exciting new feature: 𝗔𝗜-𝗣𝗵𝗼𝗻𝗲 𝗕𝗲𝗻𝗰𝗵𝗺𝗮𝗿𝗸𝗶𝗻𝗴! 🚀 you can now:
✅ Benchmark your device’s performance in running AI models.
✅ Compare results on the AI-Phone Leaderboard: huggingface.co/spaces/a-gho... on Hugging Face.

PocketPal is an #OpenSource app that lets you locally run open #LLM #AI models including those on @huggingface
https://github.com/a-ghorbani/pocketpal-ai/blob/main/docs/getting_started.md
#Android: https://play.google.com/store/apps/details?id=com.pocketpalai
iPhone […]

Wow! Hermes 3 LLM is impressive! Already GGUFs on @hf.co.

I’m playing around with Q6 one on my phone:
> Accurately follows instructions
> Great at storytelling
> Does a really good job generating structured outputs (e.g., JSON)
#Hermes @nousresearch.com #LLM #SLM

Feel free to give it a try:
🔹PocketPal AI source: (github.com/a-ghorbani/p...)
🔹 Google Play Store: play.google.com/store/apps/d...
🔹 App Store: apps.apple.com/de/app/pocke...

🤯 Ran 10B INTELLECT-1-Instruct of on my iPhone (8GB) w/ IQ2_M quantization using PocketPal AI. Dead slow (0.7 tokens/sec) but still 🔥! Few months ago, ppl would've laughed at the idea of running this on a phone. Curios what Android users w more mem can run. #llm @hf.co #llama.cpp

Download on Google Play: play.google.com/store/apps/d...
Download on the App Store: apps.apple.com/de/app/pocke...

PocketPal AI v1.5 is released 💯

You can now access to more than 45K GGUF models on the Hugging Face Hub 🤗 , directly from the application!

As a bonus, we got a brand new logo for the app too!

Huge thanks to Asghar Ghorbani!