jundot/omlx

项目介绍与用途

「jundot/omlx」是由 jundot 维护、主要使用 Python 开发的开源项目。LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar。目前该项目在 GitHub 上累计获得 18.8k 个 Star、1.6k 次 Fork（今日新增 60 Star）。如果你关注 Python 方向的开源生态，它值得收藏、学习与参考。

项目简介

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

相关项目

unslothai/unslothLocal UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.

ToolJet/ToolJetToolJet is the open-source foundation of ToolJet AI - the enterprise app generation platform for building internal tools, dashboard, business applications, workflows and AI agents 🚀

cactus-compute/needle14MB foundation model for tiny devices; phones, wearables, smart home, and robots.

cathrynlavery/diagram-design29 editorial diagram types for Claude Code. Self-contained HTML + SVG. No shadows, no Mermaid-slop.

PrimeIntellect-ai/prime-agentA self-improving RLM agent for coding workflows and long-running autonomous tasks.

NVIDIA-NeMo/SwitchyardSwitchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

项目体检

分享