Edge Compute

Model Library

Ready-to-go open models, pre-configured for one RTX 5090. Click Deploy, pick a GPU, and get an API or web UI in minutes — or bring your own model with a template.

All Text generationReasoningCodingMultimodalImage generationVideo generationAudioEmbeddings

Featured models

Text generationReasoning

Qwen3 8B

Dense 8B model with switchable thinking / non-thinking modes, strong multilingual chat and tool use.

Alibaba Qwen · 8.2B · 19 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 32B (AWQ)

The flagship dense Qwen3, 4-bit AWQ quantised to run on a single RTX 5090.

Alibaba Qwen · 32.8B · 29 GB · vLLM (OpenAI-compatible API)
ReasoningText generation

gpt-oss 20B

OpenAI's open-weight reasoning model with adjustable reasoning effort, in a ready-to-use chat UI.

OpenAI · 21B (MoE, 3.6B active) · 16 GB · Open WebUI (Ollama)
Image generation

FLUX.1 [schnell]

Fast 12B text-to-image model — high-quality images in 1–4 steps, free for commercial use.

Black Forest Labs · 12B · 20 GB · ComfyUI
Video generation

Wan 2.1 Text-to-Video 1.3B

Lightweight open text-to-video model — 480p clips on a single GPU in minutes.

Alibaba Wan · 1.3B · 12 GB · ComfyUI
Audio

Whisper Large v3

Best-in-class open speech recognition for ~100 languages, behind an OpenAI-compatible API.

OpenAI · 1.55B · 6 GB · Whisper API
Deploy your own
Any Hugging Face model with vLLM, Ollama or ComfyUI — or a plain PyTorch box.
Browse templates

Text generation

Language models for chat, code and analysis
View all (10) →
Text generationReasoning

Qwen3 8B

Dense 8B model with switchable thinking / non-thinking modes, strong multilingual chat and tool use.

Alibaba Qwen · 8.2B · 19 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 14B (FP8)

Larger Qwen3 in official FP8 weights — noticeably stronger reasoning while fitting comfortably on one GPU.

Alibaba Qwen · 14.8B · 24 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 32B (AWQ)

The flagship dense Qwen3, 4-bit AWQ quantised to run on a single RTX 5090.

Alibaba Qwen · 32.8B · 29 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen2.5 72B Instruct (AWQ)

A 70B-class model split across both GPUs of a 2× RTX 5090 machine (64 GB VRAM) with tensor parallelism.

Alibaba Qwen · 72.7B · 56 GB · 2× GPU · vLLM (OpenAI-compatible API)

Reasoning

Models that think step by step before answering
View all (8) →
Text generationReasoning

Qwen3 8B

Dense 8B model with switchable thinking / non-thinking modes, strong multilingual chat and tool use.

Alibaba Qwen · 8.2B · 19 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 14B (FP8)

Larger Qwen3 in official FP8 weights — noticeably stronger reasoning while fitting comfortably on one GPU.

Alibaba Qwen · 14.8B · 24 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen3 32B (AWQ)

The flagship dense Qwen3, 4-bit AWQ quantised to run on a single RTX 5090.

Alibaba Qwen · 32.8B · 29 GB · vLLM (OpenAI-compatible API)
Text generationReasoning

Qwen2.5 72B Instruct (AWQ)

A 70B-class model split across both GPUs of a 2× RTX 5090 machine (64 GB VRAM) with tensor parallelism.

Alibaba Qwen · 72.7B · 56 GB · 2× GPU · vLLM (OpenAI-compatible API)

Coding

Code completion, review and agents
View all (1) →
CodingText generation

Qwen2.5 Coder 14B (AWQ)

Code-specialised Qwen model for completion, generation and repair across dozens of languages.

Alibaba Qwen · 14.7B · 22 GB · vLLM (OpenAI-compatible API)

Multimodal

Understand text and images together
View all (2) →
MultimodalText generation 🔑 gated

Gemma 3 12B

Google's multimodal open model — understands images and text, 140+ languages.

Google · 12B · 28 GB · vLLM (OpenAI-compatible API)
MultimodalText generation

Gemma 3 27B (Ollama)

Google's largest Gemma 3 in 4-bit with a chat UI — multimodal and multilingual.

Google · 27B (4-bit) · 20 GB · Open WebUI (Ollama)

Image generation

Text to image
View all (3) →
Image generation

FLUX.1 [schnell]

Fast 12B text-to-image model — high-quality images in 1–4 steps, free for commercial use.

Black Forest Labs · 12B · 20 GB · ComfyUI
Image generation 🔑 gated

FLUX.1 [dev]

Higher-quality guidance-distilled FLUX model for detailed images — non-commercial licence.

Black Forest Labs · 12B · 22 GB · ComfyUI
Image generation

Stable Diffusion XL 1.0

The classic 1024px image model with the largest ecosystem of LoRAs, ControlNets and fine-tunes.

Stability AI · 3.5B · 10 GB · ComfyUI

Video generation

Text and image to video
View all (1) →
Video generation

Wan 2.1 Text-to-Video 1.3B

Lightweight open text-to-video model — 480p clips on a single GPU in minutes.

Alibaba Wan · 1.3B · 12 GB · ComfyUI

Audio

Speech recognition and transcription
View all (2) →
Audio

Whisper Large v3

Best-in-class open speech recognition for ~100 languages, behind an OpenAI-compatible API.

OpenAI · 1.55B · 6 GB · Whisper API
Audio

Distil-Whisper Large v3

Distilled Whisper — several times faster than large-v3 for English with close accuracy.

Hugging Face · 756M · 4 GB · Whisper API

Embeddings

Vectors for search and RAG
View all (1) →
Embeddings

BGE-M3 Embeddings

Multilingual embedding model for search and RAG, 8K-token inputs.

BAAI · 568M · 2 GB · Ollama