Google logo

Rent Gemma 2 27B in a private loop

Conversation and editing
By Googlegemma2:27b27B parameters8K tokens of contextGemma Terms of Use

The larger Gemma: the same polite style but noticeably deeper on facts and reasoning. Still 8K of context — not for long documents, but strong in dialogue and editing.

GPU configurations for Gemma 2 27B

1x RTX5090

Best value
~42 tok/sup to 3 streams
$0.65per hour

1x A100

~50 tok/sup to 5 streams
$1.47per hour

1x H100

~75 tok/sup to 10 streams
$3.33per hour
Pick a GPU
VRAM
RAM
Storage
vCPU
CPU

Billing follows server uptime by the hour.

Gemma 2 27B benchmarks

as published by the model vendor
Gemma 2 27B scores in public benchmarks
MMLU75.2
GSM8K74
HumanEval51.8

Other models in the private loop

FAQ

Frequently asked about renting Gemma 2 27B

Which GPU does Gemma 2 27B need?

The entry configuration is 1x RTX5090, which delivers around 42 tokens per second. For more parallel requests and headroom on speed, go with 1x H100.

How much does Gemma 2 27B cost?

An hour of Gemma 2 27B runs from $0.65 to $3.33 depending on the GPU configuration. Billing is hourly: you pay for server time, not for tokens.

How do I call Gemma 2 27B from my code?

Once deployed you get an OpenAI-compatible endpoint: point any OpenAI client at the base_url you receive and pass gemma2:27b as the model name. Code written against the OpenAI API needs no changes.

Does the data stay private?

Yes. Gemma 2 27B runs on a dedicated GPU server inside a private loop: requests and responses never reach the model vendor and are not used for training.

What context window and license does Gemma 2 27B have?

Gemma 2 27B holds 8K tokens of context per request and ships under the Gemma Terms of Use license, so you can use it commercially on your own hosting terms.