目录
master
分支81
标签138
+ 疑修
Web IDE
LocalAI [bot]
feat: Rename ‘Whisper’ model type to ‘STT’ in UI (#8785)


    

  • feat: Rename ‘Whisper’ model type to ‘STT’ in UI
    • 



    

  • Updated models.html: Changed ‘Whisper’ filter button to ‘STT’
    • 

  • Updated talk.html: Changed ‘Whisper Model’ to ‘STT Model’
    • 

  • Updated backends.html: Changed ‘Whisper’ to ‘STT’
    • 

  • Updated talk.js: Renamed getWhisperModel() to getSTTModel(),
sendAudioToWhisper() to sendAudioToSTT(), and whisperModelSelect to sttModelSelect
    • 



This change makes the UI more consistent with the model category naming,
where all speech-to-text models (including Whisper, Parakeet, Moonshine,
WhisperX, etc.) are grouped under the ‘STT’ (Speech-to-Text) category.


Fixes #8776


Signed-off-by: team-coding-agent-1 team-coding-agent-1@localai.dev


    

  • Rename whisperModelSelect to sttModelSelect in talk.html
    • 



As requested by maintainer mudler in PR review, replacing all
whisperModelSelect occurrences with sttModelSelect since the
model type was renamed from Whisper to STT.


Signed-off-by: LocalAI [bot] localai-bot@users.noreply.github.com




Signed-off-by: team-coding-agent-1 team-coding-agent-1@localai.dev
Signed-off-by: LocalAI [bot] localai-bot@users.noreply.github.com
Co-authored-by: team-coding-agent-1 team-coding-agent-1@localai.dev
Co-authored-by: LocalAI [bot] localai-bot@users.noreply.github.com
2个月前5683次提交
README.md




LocalAI forks LocalAI stars LocalAI pull-requests

LocalAI Docker hub LocalAI Quay.io

Follow LocalAI_API Join LocalAI Discord Community

mudler%2FLocalAI | Trendshift

💡 Get help - ❓FAQ 💭Discussions 💬 Discord Documentation website

💻 Quickstart 🖼️ Models 🚀 Roadmap 🛫 Examples Try on Telegram

testsBuild and Releasebuild container imagesBump dependenciesArtifact Hub

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI (Elevenlabs, Anthropic… ) API specifications for local AI inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU. It is created and maintained by Ettore Di Giacinto.

Local Stack Family

Liking LocalAI? LocalAI is part of an integrated suite of AI infrastructure tools, you might also like:

  • LocalAGI - AI agent orchestration platform with OpenAI Responses API compatibility and advanced agentic capabilities
  • LocalRecall - MCP/REST API knowledge base system providing persistent memory and storage for AI agents
  • 🆕 Cogito - Go library for building intelligent, co-operative agentic software and LLM-powered workflows, focusing on improving results for small, open source language models that scales to any LLM. Powers LocalAGI and LocalAI MCP/Agentic capabilities
  • 🆕 Wiz - Terminal-based AI agent accessible via Ctrl+Space keybinding. Portable, local-LLM friendly shell assistant with TUI/CLI modes, tool execution with approval, MCP protocol support, and multi-shell compatibility (zsh, bash, fish)
  • 🆕 SkillServer - Simple, centralized skills database for AI agents via MCP. Manages skills as Markdown files with MCP server integration, web UI for editing, Git synchronization, and full-text search capabilities

Screenshots / Video

Youtube video




Screenshots

Talk Interface Generate Audio
Screenshot 2025-03-31 at 12-01-36 LocalAI - Talk Screenshot 2025-03-31 at 12-01-29 LocalAI - Generate audio with voice-en-us-ryan-low
Models Overview Generate Images
Screenshot 2025-03-31 at 12-01-20 LocalAI - Models Screenshot 2025-03-31 at 12-31-41 LocalAI - Generate images with flux 1-dev
Chat Interface Home
Screenshot 2025-03-31 at 11-57-44 LocalAI - Chat with localai-functioncall-qwen2 5-7b-v0 5 Screenshot 2025-03-31 at 11-57-23 LocalAI API - c2a39e3 (c2a39e3639227cfd94ffffe9f5691239acc275a8)
Login Swarm
Screenshot 2025-03-31 at 12-09-59 Screenshot 2025-03-31 at 12-10-39 LocalAI - P2P dashboard

💻 Quickstart

macOS Download:

Download LocalAI for macOS

Note: the DMGs are not signed by Apple as quarantined. See https://github.com/mudler/LocalAI/issues/6268 for a workaround, fix is tracked here: https://github.com/mudler/LocalAI/issues/6244

Containers (Docker, podman, …)

💡 Docker Run vs Docker Start

  • docker run creates and starts a new container. If a container with the same name already exists, this command will fail.
  • docker start starts an existing container that was previously created with docker run.

If you’ve already run LocalAI before and want to start it again, use: docker start -i local-ai

CPU only image:

docker run -ti --name local-ai -p 8080:8080 localai/localai:latest

NVIDIA GPU Images:

# CUDA 13.0
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-gpu-nvidia-cuda-13

# CUDA 12.0
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-gpu-nvidia-cuda-12

# NVIDIA Jetson (L4T) ARM64
# CUDA 12 (for Nvidia AGX Orin and similar platforms)
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-nvidia-l4t-arm64

# CUDA 13 (for Nvidia DGX Spark)
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-nvidia-l4t-arm64-cuda-13

AMD GPU Images (ROCm):

docker run -ti --name local-ai -p 8080:8080 --device=/dev/kfd --device=/dev/dri --group-add=video localai/localai:latest-gpu-hipblas

Intel GPU Images (oneAPI):

docker run -ti --name local-ai -p 8080:8080 --device=/dev/dri/card1 --device=/dev/dri/renderD128 localai/localai:latest-gpu-intel

Vulkan GPU Images:

docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-gpu-vulkan

AIO Images (pre-downloaded models):

# CPU version
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-aio-cpu

# NVIDIA CUDA 13 version
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-aio-gpu-nvidia-cuda-13

# NVIDIA CUDA 12 version
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-aio-gpu-nvidia-cuda-12

# Intel GPU version
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-aio-gpu-intel

# AMD GPU version
docker run -ti --name local-ai -p 8080:8080 --device=/dev/kfd --device=/dev/dri --group-add=video localai/localai:latest-aio-gpu-hipblas

For more information about the AIO images and pre-downloaded models, see Container Documentation.

To load models:

# From the model gallery (see available models with `local-ai models list`, in the WebUI from the model tab, or visiting https://models.localai.io)
local-ai run llama-3.2-1b-instruct:q4_k_m
# Start LocalAI with the phi-2 model directly from huggingface
local-ai run huggingface://TheBloke/phi-2-GGUF/phi-2.Q8_0.gguf
# Install and run a model from the Ollama OCI registry
local-ai run ollama://gemma:2b
# Run a model from a configuration file
local-ai run https://gist.githubusercontent.com/.../phi-2.yaml
# Install and run a model from a standard OCI registry (e.g., Docker Hub)
local-ai run oci://localai/phi-2:latest

⚡ Automatic Backend Detection: When you install models from the gallery or YAML files, LocalAI automatically detects your system’s GPU capabilities (NVIDIA, AMD, Intel) and downloads the appropriate backend. For advanced configuration options, see GPU Acceleration.

For more information, see 💻 Getting started, if you are interested in our roadmap items and future enhancements, you can see the Issues labeled as Roadmap here

📰 Latest project news

Roadmap items: List of issues

🚀 Features

🧩 Supported Backends & Acceleration

LocalAI supports a comprehensive range of AI backends with multiple acceleration options:

Text Generation & Language Models

Backend Description Acceleration Support
llama.cpp LLM inference in C/C++ CUDA 12/13, ROCm, Intel SYCL, Vulkan, Metal, CPU
vLLM Fast LLM inference with PagedAttention CUDA 12/13, ROCm, Intel
transformers HuggingFace transformers framework CUDA 12/13, ROCm, Intel, CPU
MLX Apple Silicon LLM inference Metal (M1/M2/M3+)
MLX-VLM Apple Silicon Vision-Language Models Metal (M1/M2/M3+)

Audio & Speech Processing

Backend Description Acceleration Support
whisper.cpp OpenAI Whisper in C/C++ CUDA 12/13, ROCm, Intel SYCL, Vulkan, CPU
faster-whisper Fast Whisper with CTranslate2 CUDA 12/13, ROCm, Intel, CPU
moonshine Ultra-fast transcription engine for low-end devices CUDA 12/13, Metal, CPU
coqui Advanced TTS with 1100+ languages CUDA 12/13, ROCm, Intel, CPU
kokoro Lightweight TTS model CUDA 12/13, ROCm, Intel, CPU
chatterbox Production-grade TTS CUDA 12/13, CPU
piper Fast neural TTS system CPU
kitten-tts Kitten TTS models CPU
silero-vad Voice Activity Detection CPU
neutts Text-to-speech with voice cloning CUDA 12/13, ROCm, CPU
vibevoice Real-time TTS with voice cloning CUDA 12/13, ROCm, Intel, CPU
pocket-tts Lightweight CPU-based TTS CUDA 12/13, ROCm, Intel, CPU
qwen-tts High-quality TTS with custom voice, voice design, and voice cloning CUDA 12/13, ROCm, Intel, CPU
ace-step Music generation from text descriptions, lyrics, or audio samples CUDA 12/13, ROCm, Intel, Metal, CPU

Image & Video Generation

Backend Description Acceleration Support
stablediffusion.cpp Stable Diffusion in C/C++ CUDA 12/13, Intel SYCL, Vulkan, CPU
diffusers HuggingFace diffusion models CUDA 12/13, ROCm, Intel, Metal, CPU

Specialized AI Tasks

Backend Description Acceleration Support
rfdetr Real-time object detection CUDA 12/13, Intel, CPU
rerankers Document reranking API CUDA 12/13, ROCm, Intel, CPU
local-store Vector database CPU
huggingface HuggingFace API integration API-based

Hardware Acceleration Matrix

Acceleration Type Supported Backends Hardware Support
NVIDIA CUDA 12 All CUDA-compatible backends Nvidia hardware
NVIDIA CUDA 13 All CUDA-compatible backends Nvidia hardware
AMD ROCm llama.cpp, whisper, vllm, transformers, diffusers, rerankers, coqui, kokoro, neutts, vibevoice, pocket-tts, qwen-tts, ace-step AMD Graphics
Intel oneAPI llama.cpp, whisper, stablediffusion, vllm, transformers, diffusers, rfdetr, rerankers, coqui, kokoro, vibevoice, pocket-tts, qwen-tts, ace-step Intel Arc, Intel iGPUs
Apple Metal llama.cpp, whisper, diffusers, MLX, MLX-VLM, moonshine, ace-step Apple M1/M2/M3+
Vulkan llama.cpp, whisper, stablediffusion Cross-platform GPUs
NVIDIA Jetson (CUDA 12) llama.cpp, whisper, stablediffusion, diffusers, rfdetr, ace-step ARM64 embedded AI (AGX Orin, etc.)
NVIDIA Jetson (CUDA 13) llama.cpp, whisper, stablediffusion, diffusers, rfdetr ARM64 embedded AI (DGX Spark)
CPU Optimized All backends AVX/AVX2/AVX512, quantization support

🔗 Community and integrations

Build and deploy custom containers:

WebUIs:

Agentic Libraries:

MCPs:

OS Assistant:

  • https://github.com/mudler/Keygeist - Keygeist is an AI-powered keyboard operator that listens for key combinations and responds with AI-generated text typed directly into your Linux box.

Model galleries

Voice:

Other:

🔗 Resources

🎥 Media, Blogs, Social

🤖 Autonomous Development Team

LocalAI is now helped being maintained (for small tasks!) by a full team of autonomous AI agents led by an AI Scrum Master! This experiment demonstrates how open source projects can leverage AI agents for sustainable, long-term maintenance.

Citation

If you utilize this repository, data in a downstream project, please consider citing it with:

@misc{localai,
  author = {Ettore Di Giacinto},
  title = {LocalAI: The free, Open source OpenAI alternative},
  year = {2023},
  publisher = {GitHub},
  journal = {GitHub repository},
  howpublished = {\url{https://github.com/go-skynet/LocalAI}},

❤️ Sponsors

Do you find LocalAI useful?

Support the project by becoming a backer or sponsor. Your logo will show up here with a link to your website.

A huge thank you to our generous sponsors who support this project covering CI expenses, and our Sponsor list:

Individual sponsors

A special thanks to individual sponsors that contributed to the project, a full list is in Github and buymeacoffee, a special shout out goes to drikster80 for being generous. Thank you everyone!

🌟 Star history

LocalAI Star history Chart

📖 License

LocalAI is a community-driven project created by Ettore Di Giacinto.

MIT - Author Ettore Di Giacinto mudler@localai.io

🙇 Acknowledgements

LocalAI couldn’t have been built without the help of great software already available from the community. Thank you!

🤗 Contributors

This is a community project, a special thanks to our contributors! 🤗

关于
gohtmlpython
README.md
92.7 MB
邀请码
    Gitlink（确实开源）
  • 加入我们
  • 官网邮箱：gitlink@ccf.org.cn
    • QQ群
  • QQ群
    • 公众号
  • 公众号

版权所有：中国计算机学会技术支持：开源发展技术委员会
京ICP备13000930号-9 京公网安备 11010802032778号