BREAKING
Portable-AI-USB Runs LLMs Offline
Plug In, Run Offline
1
Copy to exFAT USB
↓
2
Run install script
↓
3
First run online
↓
4
Use fully offline
Ollama Plus AnythingLLM
Ollama
●
Runs local LLMs
●
GGUF for CPU
AnythingLLM
●
RAG chat UI
●
Model switching
Model Sizes On The Drive
NemoMix 12B
7
Dolphin 8B
4.9
Qwen 7B
4.7
Mistral 7B
4.1
Phi-3.5
2.2
Llama 3.2 3B
2
0
k
GitHub stars
0
Forks
0
s
Max response
Portable AI, No Cloud Needed
AI NEWS BLITZ
A new open-source project runs local AI models entirely from a USB flash drive.