Edge Compute

Model Library

Ready-to-go open models, pre-configured for one RTX 5090. Click Deploy, pick a GPU, and get an API or web UI in minutes — or bring your own model with a template.

All Text generationReasoningCodingMultimodalImage generationVideo generationAudioEmbeddings

Reasoning

Text generationReasoning

Qwen3 8B

Dense 8B model with switchable thinking / non-thinking modes, strong multilingual chat and tool use.

Alibaba Qwen · 8.2B · 19 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 14B (FP8)

Larger Qwen3 in official FP8 weights — noticeably stronger reasoning while fitting comfortably on one GPU.

Alibaba Qwen · 14.8B · 24 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 32B (AWQ)

The flagship dense Qwen3, 4-bit AWQ quantised to run on a single RTX 5090.

Alibaba Qwen · 32.8B · 29 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen2.5 72B Instruct (AWQ)

A 70B-class model split across both GPUs of a 2× RTX 5090 machine (64 GB VRAM) with tensor parallelism.

Alibaba Qwen · 72.7B · 56 GB · 2× GPU · vLLM (OpenAI-compatible API)
Reasoning

DeepSeek R1 Distill Qwen 7B

Small reasoning model distilled from DeepSeek-R1 — shows its chain of thought, strong at maths.

DeepSeek · 7.6B · 18 GB · vLLM (OpenAI-compatible API)
ReasoningText generation

gpt-oss 20B

OpenAI's open-weight reasoning model with adjustable reasoning effort, in a ready-to-use chat UI.

OpenAI · 21B (MoE, 3.6B active) · 16 GB · Open WebUI (Ollama)
Reasoning

DeepSeek R1 Distill 32B (Ollama)

The 32B R1 distill in 4-bit via Ollama — near-frontier reasoning on a single GPU.

DeepSeek · 32B (4-bit) · 22 GB · Ollama
Text generationReasoning

Phi-4 14B (Ollama)

Microsoft's compact model trained on high-quality synthetic data — strong maths and reasoning for 14B.

Microsoft · 14B (4-bit) · 11 GB · Ollama