Localai - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Private Local AI

Nov 12

One gaming PC, one 552B MoE: how expert offload actually works

#localai #moe #selfhosted #llm

4 min read

Private Local AI

Nov 12

Hot experts, cold RAM: a big MoE on a box with more memory than VRAM

#localai #moe #llm #hardware

3 min read

Mininglamp

Nov 12

Running Mano-P on the Cheapest Mac It Survives On

#ai #opensource #apple #localai

3 min read

devs

Nov 11

Speech Studio 0.5.0 Drops Local Multi-Engine TTS+STT on Windows — First-Sound Latency Still Sets the Overlay Floor

#windows #audio #stt #localai

4 min read

Private Local AI

Nov 11

MCP servers, and what they let a local model actually do: Blender, CADCraft and the DWG problem

#localai #opensource #selfhosted #machinelearning

17 min read

Hanako H.

Nov 9

How to make a local AI model give the same answer every time

#ai #llm #localai #tutorial

3 min read

Josep Oriol Carné

Nov 8

My Go-To Prompt for Testing Local LLMs

#llm #ollama #localai #nvidia

1 min read

devs

Nov 7

Apiiro’s Claude Code Scan Found 2,539 Secrets in .claude/settings.local.json — Local Desktop Tools Keep Credentials Off the Git Path

#claudecode #security #windows #localai

3 min read

devs

Nov 7

Hugging Face’s 70k-Word MoE Handbook After 800k GPU Hours — Why Sparsity Still Wins for Local Real-Time Tools

#moe #inference #localai #windows

4 min read

jamilxt

Nov 11

Ollama vs LM Studio: Which Local AI App Should You Use on a Mac?

#ai #localai #ollama #lmstudio

7 min read

Private Local AI

Nov 11

Xolotl - running a 552-billion MoE on one gaming PC, and what it asks of a constrained machine

#localai #opensource #selfhosted #machinelearning

7 min read

Nov 6

Jan open source ChatGPT alternative: offline local AI

#llamacpp #llm #localai #mcp

7 min read

devs

Nov 6

Foundry Local + Qwen3.8-27B Turns GitHub Copilot Local — Windows Audio Still Owns the Real-Time Budget

#windows #localai #githubcopilot #llm

4 min read

johnettagaweraks

Nov 5

LocalAI API exposure and the model-management control plane

#zoomeye #localai #aisecurity #apisecurity

3 min read

devs

Nov 5

llama.cpp 0.9.0 Ships Chatterbox TTS and OCP FP8 — Local Speech Still Dies on the Windows Capture Path

#windows #audio #llm #localai

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.