LLM Server app icon

LLM Server

Linosec

★ 3.02 ratingsBusiness$19.99

iPhone Screenshots

App screenshotApp screenshotApp screenshotApp screenshotApp screenshotApp screenshotApp screenshotApp screenshotApp screenshotApp screenshot

Description

Your Phone Is Now an AI Server LLM Server turns your iPhone or iPad into a private AI inference server. Run large language models, embedding models and image generation models entirely on-device, expose OpenAI-compatible APIs to your local network, and chat or create images from any browser on any device — laptop, desktop, tablet, even another phone. No cloud, no subscription, no data leaving your hardware. Chat From Any Browser on Your Network Start the server and open the URL on any device sharing your Wi-Fi. The built-in web interface gives you a clean chat UI instantly — no client app to install, no account to create. Your laptop, your partner's tablet, a colleague's machine: all talking to a model running on your phone. Generate Images On-Device Load a Stable Diffusion model (GGUF, powered by stable-diffusion.cpp) and switch the web interface to Images mode. Type a prompt, pick the size, steps, CFG scale, seed, sampler and scheduler, and watch the progress live. Save, copy, reuse settings or send an image to chat. Image generation runs alongside your chat model in its own slot. Embeddings for Search and RAG Load an embedding model next to your chat model and turn text into vectors on-device. Build semantic search, retrieval-augmented generation (RAG) and document indexing on a private, local backend. OpenAI-Compatible API, Drop-In Ready A standard OpenAI-compatible API means LLM Server slots into any tool you already use — Continue, Open WebUI, LangChain, custom scripts, the lot. Chat completions, text completions, embeddings (/v1/embeddings), image generation (/v1/images/generations), streaming (SSE), and model listing endpoints all supported. Ollama CLI commands work too, including /api/embed. Fully Offline, Fully Yours - Download a GGUF model once and you're done with the cloud. Inference runs locally on Apple Metal GPU with no internet required. Your prompts, your conversations, your images, your data — none of it leaves the device. Airplane mode works fine. Any GGUF Model From Hugging Face - Browse and download directly from Hugging Face with built-in search, or import your own files. LLaMA, Mistral, Phi, Gemma, Qwen, DeepSeek, and every other llama.cpp-supported architecture runs out of the box, plus embedding models and Stable Diffusion image models. Background downloads with progress tracking so you can keep working. Enterprise-Grade Security - TLS/HTTPS encryption — generate self-signed certificates or import your own chain and private key. - API key authentication — Bearer tokens with per-key management. Generate cryptographically secure keys or bring your own. - Bind control — lock to localhost, open to your LAN, or pin to a specific interface. - Optional Web Search Tools (currently supporting Perplexity, Brave, Exa, Tavily and Ollama API keys, more will be added later) Tune Every Knob Full control over generation: context size up to 32K, temperature, top-p, top-k, repeat penalty, frequency and presence penalties, max tokens, seed, GPU layer offloading, and thread count. Save presets globally or per model. Smart Resource Management Your phone stays responsive under load. Real-time thermal monitoring with automatic thread reduction under pressure and request rejection at critical temperatures. Memory-aware model loading with conservative budgeting. Configurable request queues and per-request timeouts. Built for Developers - Live API docs with copy-paste curl examples - Structured logging (debug, info, warning, error) - One-tap copy for server addresses and API keys What's Inside Dashboard with one-tap server control, model manager with download progress, complete settings hub (server, inference, image generation, security, API keys, developer tools), and guided onboarding for first-time setup.