Edge Compute

Model Library

Ready-to-go open models, pre-configured for one RTX 5090. Click Deploy, pick a GPU, and get an API or web UI in minutes — or bring your own model with a template.

All Text generationReasoningCodingMultimodalImage generationVideo generationAudioEmbeddings

Text generation

Text generationReasoning

Qwen3 8B

Dense 8B model with switchable thinking / non-thinking modes, strong multilingual chat and tool use.

Alibaba Qwen · 8.2B · 19 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 14B (FP8)

Larger Qwen3 in official FP8 weights — noticeably stronger reasoning while fitting comfortably on one GPU.

Alibaba Qwen · 14.8B · 24 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 32B (AWQ)

The flagship dense Qwen3, 4-bit AWQ quantised to run on a single RTX 5090.

Alibaba Qwen · 32.8B · 29 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen2.5 72B Instruct (AWQ)

A 70B-class model split across both GPUs of a 2× RTX 5090 machine (64 GB VRAM) with tensor parallelism.

Alibaba Qwen · 72.7B · 56 GB · 2× GPU · vLLM (OpenAI-compatible API)
CodingText generation

Qwen2.5 Coder 14B (AWQ)

Code-specialised Qwen model for completion, generation and repair across dozens of languages.

Alibaba Qwen · 14.7B · 22 GB · vLLM (OpenAI-compatible API)
Text generation 🔑 gated

Llama 3.1 8B Instruct

Meta's widely used 8B instruct model with 128K native context and tool calling.

Meta · 8B · 19 GB · vLLM (OpenAI-compatible API)
MultimodalText generation 🔑 gated

Gemma 3 12B

Google's multimodal open model — understands images and text, 140+ languages.

Google · 12B · 28 GB · vLLM (OpenAI-compatible API)
ReasoningText generation

gpt-oss 20B

OpenAI's open-weight reasoning model with adjustable reasoning effort, in a ready-to-use chat UI.

OpenAI · 21B (MoE, 3.6B active) · 16 GB · Open WebUI (Ollama)
MultimodalText generation

Gemma 3 27B (Ollama)

Google's largest Gemma 3 in 4-bit with a chat UI — multimodal and multilingual.

Google · 27B (4-bit) · 20 GB · Open WebUI (Ollama)
Text generationReasoning

Phi-4 14B (Ollama)

Microsoft's compact model trained on high-quality synthetic data — strong maths and reasoning for 14B.

Microsoft · 14B (4-bit) · 11 GB · Ollama