← heapsort-ai

setup guide

5 items

DOCDEV.to AI·16d ago

로컬 LLM 셋업 가이드 (v6)

This guide details the setup of local LLMs for data privacy and performance, recommending Ollama due to its easy installation, support for various models, and simple API interface. It covers hardware requirements, installation steps, and a comparison of frameworks.

28
DOCDEV.to AI·16d ago

로컬 LLM 셋업 가이드 (v14)

This guide (v14) details the setup of local LLMs, covering hardware requirements (RAM, VRAM), supported operating systems, and system information checks. It compares frameworks like llama.cpp, Ollama, vLLM, and LocalAI, and provides a step-by-step tutorial to install dependencies, compile llama.cpp, download a model, and run a local server.

27