Go Tsamaisa Private AI Models mo VPS: Kaelo ya DeepSeek & Llama
Ithute go tsamaisa di-LLM tse di maatla jaaka DeepSeek-R1 le Llama 3 mo VPS ya gago go nna le boiphitlho jwa data bo bo feletseng.

AI e fetola tsela e re berekang ka yone, mme go dirisa di-model tsa cloud jaaka ChatGPT go raya go abelana data ya gago e e sensitifi le dikhampani. Mokgwa wa ga jaana ke Local AI. Ka VPS e e nang le tiragatso e e kwa godimo go tswa kwa Hiddence (segolo jang di-plan tsa rona tsa Ryzen 9 le Intel Core i9), o ka tsamaisa agency ya gago ya boitseanape mo cloud, o boloka di-prompt le data tsa gago e le poraefete ka 100%.
Ditlhokego tsa Hardware
Di-LLM di tlhoka RAM le di-CPU tse di bonako. Re kgothaletsa:
- Bonnye: 16GB RAM ya di-model tsa 7B/8B (Llama 3, DeepSeek-7B)
- Kgothalediwa: 32GB+ RAM ya di-model tse dikgolo kgotsa context e e kwa godimo
- CPU: Modern AMD Ryzen 9 kgotsa Intel Core i9 ya inference e e bonako ntle le GPU
1. Tsenya Ollama
Ollama ke tsela e e bonolo go gaisa ya go tsamaisa di-LLM mo Linux.
curl -fsSL https://ollama.com/install.sh | sh2. Lada Model ya Gago
Ya coding le ditiro tsa kakaretso, DeepSeek-R1 ke e e dirang sentle thata. Ya chat ya kakaretso, Llama 3 e molemo.
ollama pull deepseek-r1:8b
# KGOTSA
ollama pull llama33. Senola ka API (Ka Pabalesego)
Ollama e fana ka API e e tsamaelanang le OpenAI. O ka e tunnel ka SSH go e fitlhelela ka pabalesego go tswa mo mochineng wa gago wa selegae ntle le go e senola kwa webeng e e bulegileng.
ssh -L 11434:localhost:11434 root@your-vps-ip
# Jaanong fitlhelela http://localhost:11434 mo di-app tsa gago tsa selegae