TextImage vLLM (OpenAI-compatible API)🔑 gated

Gemma 3 12B

Google's multimodal open model — understands images and text, 140+ languages.

Overview

Gemma 3 12B accepts images alongside text, so it can describe photos, read charts and answer questions about screenshots. Accept Google's terms on Hugging Face and provide your token when deploying.

Key features

✓
Image + text input
✓
140+ languages
✓
OpenAI-compatible vision API

Use cases

→
Image captioning and Q&A
→
Reading charts and documents
→
Multilingual assistants

On this template

Runs on the vLLM (OpenAI-compatible API) template, exposing its OpenAI-compatible API at a private HTTPS address. You also get root SSH and JupyterLab.

`MODEL_ID`	`google/gemma-3-12b-it`
`VLLM_ARGS`	`--max-model-len 8192 --gpu-memory-utilization 0.92`

Quick start

Click Deploy and pick an available GPU — only offers with enough VRAM are shown.
Wait for the status to turn running. The first start downloads the model, which can take a few minutes.
Use the connection details on your rental page:

curl

curl https://r12-abcd1234-app.gpu.clearlayer.ca/v1/chat/completions \
  -H "Authorization: Bearer <app-token>" \
  -H "Content-Type: application/json" \
  -d '{"model": "google/gemma-3-12b-it", "messages": [{"role": "user", "content": "Hello!"}]}'

Python

from openai import OpenAI

client = OpenAI(base_url="https://r12-abcd1234-app.gpu.clearlayer.ca/v1", api_key="<app-token>")
resp = client.chat.completions.create(
    model="google/gemma-3-12b-it",
    messages=[{"role": "user", "content": "Hello!"}],
)
print(resp.choices[0].message.content)