← heapsort-ai

LLM

612 items

DOCDEV.to AI·16d ago

로컬 LLM 셋업 가이드 (v14)

This guide (v14) details the setup of local LLMs, covering hardware requirements (RAM, VRAM), supported operating systems, and system information checks. It compares frameworks like llama.cpp, Ollama, vLLM, and LocalAI, and provides a step-by-step tutorial to install dependencies, compile llama.cpp, download a model, and run a local server.

27
ARTICLEDEV.to AI·4/12/2026

QIS vs DiLoCo: Why Google's Distributed Training Breakthrough and Quadratic Intelligence Swarm Solve Completely Different Problems

This article differentiates Google's distributed training solutions (DiLoCo/DiPaCo) from the Quadratic Intelligence Swarm (QIS) protocol. It highlights that while Google's tools optimize large-scale training of single models, QIS focuses on decentralized routing of learning outcomes among multiple institutions without centralizing data.

27
RESEARCHDEV.to AI·20d ago

Self-evolving retrieval lifts benchmark scores 25%

AI agents that adapt their retrieval configurations while running deliver a 25.7% performance lift on established benchmarks, overturning the assumption that retrieval stacks should be frozen. This new paradigm allows an LLM-driven "diagnosis" module to rewrite its search strategy as new queries arrive, treating the entire memory-access pipeline as a mutable policy.

27
ARTICLEDEV.to AI·14d ago

98. RAG: Give Your AI Access to Your Documents

RAG (Retrieval Augmented Generation) addresses LLM hallucinations by integrating external knowledge. It retrieves relevant documents from a knowledge base to ground the LLM's answers in real content, offering an effective solution for knowledge-heavy tasks.

27