Seth/gemma4-research
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
Files
master
gemma4-research/tooling/google-official/docs/ai-google-dev_formatting.html
T
Mortdecai eecebe7ef5 docs: add canonical tooling corpus (147 files) from Google/HF/frameworks 
Five-lane parallel research pass. Each subdir under tooling/ has its own
README indexing downloaded files with verified upstream sources.

- google-official/: deepmind-gemma JAX examples, gemma_pytorch scripts,
  gemma.cpp API server docs, google-gemma/cookbook notebooks, ai.google.dev
  HTML snapshots, Gemma 3 tech report
- huggingface/: 8 gemma-4-* model cards, chat-template .jinja files,
  tokenizer_config.json, transformers gemma4/ source, launch blog posts,
  official HF Spaces app.py
- inference-frameworks/: vLLM/llama.cpp/MLX/Keras-hub/TGI/Gemini API/Vertex AI
  comparison, run_commands.sh with 8 working launches, 9 code snippets
- gemma-family/: 12 per-variant briefs (ShieldGemma 2, CodeGemma, PaliGemma 2,
  Recurrent/Data/Med/TxGemma, Embedding/Translate/Function/Dolphin/SignGemma)
- fine-tuning/: Unsloth Gemma 4 notebooks, Axolotl YAMLs (incl 26B-A4B MoE),
  TRL scripts, Google cookbook fine-tune notebooks, recipe-recommendation.md

Findings that update earlier CORPUS_* docs are flagged in tooling/README.md
(not applied) — notably the new <|turn>/<turn|> prompt format, gemma_pytorch
abandonment, gemma.cpp Gemini-API server, transformers AutoModelForMultimodalLM,
FA2 head_dim=512 break, 26B-A4B MoE quantization rules, no Gemma 4 tech
report PDF yet, no Gemma-4-generation specialized siblings yet.

Pre-commit secrets hook bypassed per user authorization — flagged "secrets"
are base64 notebook cell outputs and example Ed25519 keys in the HDP
agentic-security demo, not real credentials.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
2026-04-18 12:24:48 -04:00

4632 lines
134 KiB
HTML
Raw Permalink Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
<!doctype html>
<html
lang="en"
dir="ltr">
<head>
<meta name="google-signin-client-id" content="157101835696-ooapojlodmuabs2do2vuhhnf90bccmoi.apps.googleusercontent.com"><meta name="google-signin-scope"
content="profile email https://www.googleapis.com/auth/developerprofiles https://www.googleapis.com/auth/developerprofiles.award https://www.googleapis.com/auth/devprofiles.full_control.firstparty"><meta property="og:site_name" content="Google AI for Developers">
<meta property="og:type" content="website"><meta name="theme-color" content="#1967d2"><meta charset="utf-8">
<meta content="IE=Edge" http-equiv="X-UA-Compatible">
<meta name="viewport" content="width=device-width, initial-scale=1">
<link rel="manifest" href="/_pwa/googledevai/manifest.json"
crossorigin="use-credentials">
<link rel="preconnect" href="//www.gstatic.com" crossorigin>
<link rel="preconnect" href="//fonts.googleapis.com" crossorigin>
<link rel="preconnect" href="//www.google-analytics.com" crossorigin><link rel="stylesheet" href="//fonts.googleapis.com/css?family=Google+Sans:400,500|Roboto:400,400italic,500,500italic,700,700italic|Roboto+Mono:400,500,700|Inter:400,500|Inter+Tight:300,500,600&display=swap">
<link rel="stylesheet"
href="//fonts.googleapis.com/css2?family=Material+Icons&family=Material+Symbols+Outlined&display=block"><link rel="stylesheet" href="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/css/app.css">
<link rel="stylesheet" href="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/css/dark-theme.css" disabled>
<link rel="shortcut icon" href="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/favicon-new.png">
<link rel="apple-touch-icon" href="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/touchicon-180-new.png"><link rel="canonical" href="https://ai.google.dev/gemma/docs/core/prompt-structure"><link rel="search" type="application/opensearchdescription+xml"
title="Google AI for Developers" href="https://ai.google.dev/s/opensearch.xml">
<link rel="alternate" hreflang="en"
href="https://ai.google.dev/gemma/docs/core/prompt-structure" /><link rel="alternate" hreflang="x-default" href="https://ai.google.dev/gemma/docs/core/prompt-structure" /><link rel="alternate" hreflang="ar"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=ar" /><link rel="alternate" hreflang="bn"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=bn" /><link rel="alternate" hreflang="zh-Hans"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=zh-cn" /><link rel="alternate" hreflang="zh-Hant"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=zh-tw" /><link rel="alternate" hreflang="fa"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=fa" /><link rel="alternate" hreflang="fr"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=fr" /><link rel="alternate" hreflang="de"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=de" /><link rel="alternate" hreflang="he"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=he" /><link rel="alternate" hreflang="hi"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=hi" /><link rel="alternate" hreflang="id"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=id" /><link rel="alternate" hreflang="it"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=it" /><link rel="alternate" hreflang="ja"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=ja" /><link rel="alternate" hreflang="ko"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=ko" /><link rel="alternate" hreflang="pl"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=pl" /><link rel="alternate" hreflang="pt-BR"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=pt-br" /><link rel="alternate" hreflang="ru"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=ru" /><link rel="alternate" hreflang="es-419"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=es-419" /><link rel="alternate" hreflang="th"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=th" /><link rel="alternate" hreflang="tr"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=tr" /><link rel="alternate" hreflang="vi"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=vi" /><link rel="alternate" hreflang="sq"
href="https://ai.google.dev/gemma/docs/core/prompt-structure?hl=sq" /><title>Gemma formatting and system instructions &nbsp;|&nbsp; Google AI for Developers</title>
<meta property="og:title" content="Gemma formatting and system instructions &nbsp;|&nbsp; Google AI for Developers"><meta property="og:url" content="https://ai.google.dev/gemma/docs/core/prompt-structure"><meta property="og:image" content="https://ai.google.dev/static/site-assets/images/share.png">
<meta property="og:image:width" content="1200">
<meta property="og:image:height" content="675"><meta property="og:locale" content="en"><meta name="twitter:card" content="summary_large_image"><script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "Article",
"headline": "Gemma formatting and system instructions"
}
</script><script type="application/ld+json">
{
"@context": "https://schema.org",
"@type": "BreadcrumbList",
"itemListElement": [{
"@type": "ListItem",
"position": 1,
"name": "Gemma",
"item": "https://ai.google.dev/gemma"
},{
"@type": "ListItem",
"position": 2,
"name": "Gemma formatting and system instructions",
"item": "https://ai.google.dev/gemma/docs/core/prompt-structure"
}]
}
</script>
</head>
<body class="color-scheme--light"
template="page"
theme="googledevai-theme"
type="article"
appearance
layout="docs"
display-toc
pending>
<devsite-progress type="indeterminate" id="app-progress"></devsite-progress>
<a href="#main-content" class="skip-link button">
Skip to main content
</a>
<section class="devsite-wrapper">
<devsite-cookie-notification-bar></devsite-cookie-notification-bar>
<devsite-header role="banner" keep-tabs-visible>
<div class="devsite-header--inner" data-nosnippet>
<div class="devsite-top-logo-row-wrapper-wrapper">
<div class="devsite-top-logo-row-wrapper">
<div class="devsite-top-logo-row">
<button type="button" id="devsite-hamburger-menu"
class="devsite-header-icon-button button-flat material-icons gc-analytics-event"
data-category="Site-Wide Custom Events"
data-label="Navigation menu button"
visually-hidden
aria-label="Open menu">
</button>
<div class="devsite-product-name-wrapper">
<a href="/" class="devsite-site-logo-link gc-analytics-event"
data-category="Site-Wide Custom Events" data-label="Site logo" track-type="globalNav"
track-name="googleAIForDevelopers" track-metadata-position="nav"
track-metadata-eventDetail="nav">
<picture>
<source srcset="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/lockup-dark-theme-new.svg"
media="(prefers-color-scheme: dark)"
class="devsite-dark-theme">
<img src="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/lockup-new.svg" class="devsite-site-logo" alt="Google AI for Developers">
</picture>
</a>
</div>
<div class="devsite-top-logo-row-middle">
<div class="devsite-header-upper-tabs">
<devsite-tabs class="upper-tabs">
<nav class="devsite-tabs-wrapper" aria-label="Upper tabs">
<tab class="devsite-dropdown
devsite-dropdown-full
devsite-active
">
<a href="https://deepmind.google/models/gemma"
class="devsite-tabs-content gc-analytics-event "
track-metadata-eventdetail="https://deepmind.google/models/gemma"
track-type="nav"
track-metadata-position="nav - models"
track-metadata-module="primary nav"
aria-label="Models, selected"
data-category="Site-Wide Custom Events"
data-label="Tab: Models"
track-name="models"
>
Models
</a>
<button
aria-haspopup="menu"
aria-expanded="false"
aria-label="Dropdown menu for Models"
track-type="nav"
track-metadata-eventdetail="https://deepmind.google/models/gemma"
track-metadata-position="nav - models"
track-metadata-module="primary nav"
data-category="Site-Wide Custom Events"
data-label="Tab: Models"
track-name="models"
class="devsite-tabs-dropdown-toggle devsite-icon devsite-icon-arrow-drop-down"></button>
<div class="devsite-tabs-dropdown" role="menu" aria-label="submenu" hidden>
<div class="devsite-tabs-dropdown-content">
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-title" role="heading" tooltip>Gemini</li>
<li class="devsite-nav-item">
<a href="https://deepmind.google/gemini"
track-type="nav"
track-metadata-eventdetail="https://deepmind.google/gemini"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="gemini"
tooltip
>
<div class="devsite-nav-item-title">
About
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/gemini-api/docs"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/gemini-api/docs"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="gemini"
tooltip
>
<div class="devsite-nav-item-title">
Docs
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/api"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/api"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="gemini"
tooltip
>
<div class="devsite-nav-item-title">
API reference
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/pricing"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/pricing"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="gemini"
tooltip
>
<div class="devsite-nav-item-title">
Pricing
</div>
</a>
</li>
</ul>
</div>
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-title" role="heading" tooltip>Imagen</li>
<li class="devsite-nav-item">
<a href="https://deepmind.google/technologies/imagen/"
track-type="nav"
track-metadata-eventdetail="https://deepmind.google/technologies/imagen/"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="imagen"
tooltip
>
<div class="devsite-nav-item-title">
About
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/gemini-api/docs/imagen"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/gemini-api/docs/imagen"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="imagen"
tooltip
>
<div class="devsite-nav-item-title">
Docs
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/pricing"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/pricing"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="imagen"
tooltip
>
<div class="devsite-nav-item-title">
Pricing
</div>
</a>
</li>
</ul>
</div>
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-title" role="heading" tooltip>Veo</li>
<li class="devsite-nav-item">
<a href="https://deepmind.google/technologies/veo/veo-2/"
track-type="nav"
track-metadata-eventdetail="https://deepmind.google/technologies/veo/veo-2/"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="veo"
tooltip
>
<div class="devsite-nav-item-title">
About
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/gemini-api/docs/video"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/gemini-api/docs/video"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="veo"
tooltip
>
<div class="devsite-nav-item-title">
Docs
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/pricing"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/pricing"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="veo"
tooltip
>
<div class="devsite-nav-item-title">
Pricing
</div>
</a>
</li>
</ul>
</div>
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-title" role="heading" tooltip>Gemma</li>
<li class="devsite-nav-item">
<a href="https://deepmind.google/models/gemma"
track-type="nav"
track-metadata-eventdetail="https://deepmind.google/models/gemma"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="gemma"
tooltip
>
<div class="devsite-nav-item-title">
About
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/gemma/docs"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/gemma/docs"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="gemma"
tooltip
>
<div class="devsite-nav-item-title">
Docs
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/gemma/gemmaverse"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/gemma/gemmaverse"
track-metadata-position="nav - models"
track-metadata-module="tertiary nav"
track-metadata-module_headline="gemma"
tooltip
>
<div class="devsite-nav-item-title">
Gemmaverse
</div>
</a>
</li>
</ul>
</div>
</div>
</div>
</tab>
<tab class="devsite-dropdown
devsite-dropdown-full
">
<button
class="devsite-tabs-content devsite-tabs-dropdown-only gc-analytics-event devsite-icon devsite-icon-arrow-drop-down"
track-type="nav"
track-metadata-position="nav - solutions"
track-metadata-module="primary nav"
data-category="Site-Wide Custom Events"
data-label="Tab: Solutions"
track-name="solutions"
>
Solutions
</button>
<div class="devsite-tabs-dropdown" role="menu" aria-label="submenu" hidden>
<div class="devsite-tabs-dropdown-content">
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-title" role="heading" tooltip>Build with Gemini</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/gemini-api/docs"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/gemini-api/docs"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="build with gemini"
tooltip
>
<div class="devsite-nav-item-title">
Gemini API
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://aistudio.google.com"
track-type="nav"
track-metadata-eventdetail="https://aistudio.google.com"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="build with gemini"
tooltip
>
<div class="devsite-nav-item-title">
Google AI Studio
</div>
</a>
</li>
</ul>
</div>
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-title" role="heading" tooltip>Customize Gemma open models</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/gemma"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/gemma"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="customize gemma open models"
tooltip
>
<div class="devsite-nav-item-title">
Gemma open models
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://keras.io/keras_3/"
track-type="nav"
track-metadata-eventdetail="https://keras.io/keras_3/"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="customize gemma open models"
tooltip
>
<div class="devsite-nav-item-title">
Multi-framework with Keras
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://colab.sandbox.google.com/github/google/generative-ai-docs/blob/main/site/en/gemma/docs/lora_tuning.ipynb"
track-type="nav"
track-metadata-eventdetail="https://colab.sandbox.google.com/github/google/generative-ai-docs/blob/main/site/en/gemma/docs/lora_tuning.ipynb"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="customize gemma open models"
tooltip
>
<div class="devsite-nav-item-title">
Fine-tune in Colab
</div>
</a>
</li>
</ul>
</div>
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-title" role="heading" tooltip>Run on-device</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/edge"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/edge"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="run on-device"
tooltip
>
<div class="devsite-nav-item-title">
Google AI Edge
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://developer.android.com/ai/gemini-nano"
track-type="nav"
track-metadata-eventdetail="https://developer.android.com/ai/gemini-nano"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="run on-device"
tooltip
>
<div class="devsite-nav-item-title">
Gemini Nano on Android
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://developer.chrome.com/docs/ai/built-in"
track-type="nav"
track-metadata-eventdetail="https://developer.chrome.com/docs/ai/built-in"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="run on-device"
tooltip
>
<div class="devsite-nav-item-title">
Chrome built-in web APIs
</div>
</a>
</li>
</ul>
</div>
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-title" role="heading" tooltip>Build responsibly</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/responsible"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/responsible"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="build responsibly"
tooltip
>
<div class="devsite-nav-item-title">
Responsible GenAI Toolkit
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://saif.google"
track-type="nav"
track-metadata-eventdetail="https://saif.google"
track-metadata-position="nav - solutions"
track-metadata-module="tertiary nav"
track-metadata-module_headline="build responsibly"
tooltip
>
<div class="devsite-nav-item-title">
Secure AI Framework
</div>
</a>
</li>
</ul>
</div>
</div>
</div>
</tab>
<tab class="devsite-dropdown
">
<button
class="devsite-tabs-content devsite-tabs-dropdown-only gc-analytics-event devsite-icon devsite-icon-arrow-drop-down"
track-type="nav"
track-metadata-position="nav - code assistance"
track-metadata-module="primary nav"
data-category="Site-Wide Custom Events"
data-label="Tab: Code assistance"
track-name="code assistance"
>
Code assistance
</button>
<div class="devsite-tabs-dropdown" role="menu" aria-label="submenu" hidden>
<div class="devsite-tabs-dropdown-content">
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-item">
<a href="https://developer.android.com/gemini-in-android"
track-type="nav"
track-metadata-eventdetail="https://developer.android.com/gemini-in-android"
track-metadata-position="nav - code assistance"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
Android Studio
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://developer.chrome.com/docs/devtools/console/understand-messages"
track-type="nav"
track-metadata-eventdetail="https://developer.chrome.com/docs/devtools/console/understand-messages"
track-metadata-position="nav - code assistance"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
Chrome DevTools
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://colab.google"
track-type="nav"
track-metadata-eventdetail="https://colab.google"
track-metadata-position="nav - code assistance"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
Colab
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://firebase.google.com/products/generative-ai"
track-type="nav"
track-metadata-eventdetail="https://firebase.google.com/products/generative-ai"
track-metadata-position="nav - code assistance"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
Firebase
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://cloud.google.com/products/gemini/code-assist"
track-type="nav"
track-metadata-eventdetail="https://cloud.google.com/products/gemini/code-assist"
track-metadata-position="nav - code assistance"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
Google Cloud
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://plugins.jetbrains.com/plugin/8079-google-cloud-code"
track-type="nav"
track-metadata-eventdetail="https://plugins.jetbrains.com/plugin/8079-google-cloud-code"
track-metadata-position="nav - code assistance"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
JetBrains
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://labs.google.com/jules/home"
track-type="nav"
track-metadata-eventdetail="https://labs.google.com/jules/home"
track-metadata-position="nav - code assistance"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
Jules
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://marketplace.visualstudio.com/items?itemName=GoogleCloudTools.cloudcode"
track-type="nav"
track-metadata-eventdetail="https://marketplace.visualstudio.com/items?itemName=GoogleCloudTools.cloudcode"
track-metadata-position="nav - code assistance"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
VS Code
</div>
</a>
</li>
</ul>
</div>
</div>
</div>
</tab>
<tab class="devsite-dropdown
">
<button
class="devsite-tabs-content devsite-tabs-dropdown-only gc-analytics-event devsite-icon devsite-icon-arrow-drop-down"
track-type="nav"
track-metadata-position="nav - community"
track-metadata-module="primary nav"
data-category="Site-Wide Custom Events"
data-label="Tab: Community"
track-name="community"
>
Community
</button>
<div class="devsite-tabs-dropdown" role="menu" aria-label="submenu" hidden>
<div class="devsite-tabs-dropdown-content">
<div class="devsite-tabs-dropdown-column
">
<ul class="devsite-tabs-dropdown-section
">
<li class="devsite-nav-item">
<a href="https://discuss.ai.google.dev"
track-type="nav"
track-metadata-eventdetail="https://discuss.ai.google.dev"
track-metadata-position="nav - community"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
Google AI Forum
</div>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://ai.google.dev/gemini-api/docs/gemini-for-research"
track-type="nav"
track-metadata-eventdetail="https://ai.google.dev/gemini-api/docs/gemini-for-research"
track-metadata-position="nav - community"
track-metadata-module="tertiary nav"
tooltip
>
<div class="devsite-nav-item-title">
Gemini for Research
</div>
</a>
</li>
</ul>
</div>
</div>
</div>
</tab>
</nav>
</devsite-tabs>
</div>
<devsite-search
enable-signin
enable-search
enable-suggestions
enable-query-completion
enable-search-summaries
project-name="Gemma"
tenant-name="Google AI for Developers"
project-scope="/gemma"
url-scoped="https://ai.google.dev/s/results/gemma"
>
<form class="devsite-search-form" action="https://ai.google.dev/s/results" method="GET">
<div class="devsite-search-container">
<button type="button"
search-open
class="devsite-search-button devsite-header-icon-button button-flat material-icons"
aria-label="Open search"></button>
<div class="devsite-searchbox">
<input
aria-activedescendant=""
aria-autocomplete="list"
aria-label="Search"
aria-expanded="false"
aria-haspopup="listbox"
autocomplete="off"
class="devsite-search-field devsite-search-query"
name="q"
placeholder="Search"
role="combobox"
type="text"
value=""
>
<div class="devsite-search-image material-icons" aria-hidden="true">
<svg class="devsite-search-ai-image" width="24" height="24" viewBox="0 0 24 24" fill="none" xmlns="http://www.w3.org/2000/svg">
<g clip-path="url(#clip0_6641_386)">
<path d="M19.6 21L13.3 14.7C12.8 15.1 12.225 15.4167 11.575 15.65C10.925 15.8833 10.2333 16 9.5 16C7.68333 16 6.14167 15.375 4.875 14.125C3.625 12.8583 3 11.3167 3 9.5C3 7.68333 3.625 6.15 4.875 4.9C6.14167 3.63333 7.68333 3 9.5 3C10.0167 3 10.5167 3.05833 11 3.175C11.4833 3.275 11.9417 3.43333 12.375 3.65L10.825 5.2C10.6083 5.13333 10.3917 5.08333 10.175 5.05C9.95833 5.01667 9.73333 5 9.5 5C8.25 5 7.18333 5.44167 6.3 6.325C5.43333 7.19167 5 8.25 5 9.5C5 10.75 5.43333 11.8167 6.3 12.7C7.18333 13.5667 8.25 14 9.5 14C10.6667 14 11.6667 13.625 12.5 12.875C13.35 12.1083 13.8417 11.15 13.975 10H15.975C15.925 10.6333 15.7833 11.2333 15.55 11.8C15.3333 12.3667 15.05 12.8667 14.7 13.3L21 19.6L19.6 21ZM17.5 12C17.5 10.4667 16.9667 9.16667 15.9 8.1C14.8333 7.03333 13.5333 6.5 12 6.5C13.5333 6.5 14.8333 5.96667 15.9 4.9C16.9667 3.83333 17.5 2.53333 17.5 0.999999C17.5 2.53333 18.0333 3.83333 19.1 4.9C20.1667 5.96667 21.4667 6.5 23 6.5C21.4667 6.5 20.1667 7.03333 19.1 8.1C18.0333 9.16667 17.5 10.4667 17.5 12Z" fill="#5F6368"/>
</g>
<defs>
<clipPath id="clip0_6641_386">
<rect width="24" height="24" fill="white"/>
</clipPath>
</defs>
</svg>
</div>
<div class="devsite-search-shortcut-icon-container" aria-hidden="true">
<kbd class="devsite-search-shortcut-icon">/</kbd>
</div>
</div>
</div>
</form>
<button type="button"
search-close
class="devsite-search-button devsite-header-icon-button button-flat material-icons"
aria-label="Close search"></button>
</devsite-search>
</div>
<devsite-appearance-selector></devsite-appearance-selector>
<devsite-language-selector>
<ul role="presentation">
<li role="presentation">
<a role="menuitem" lang="en"
>English</a>
</li>
<li role="presentation">
<a role="menuitem" lang="de"
>Deutsch</a>
</li>
<li role="presentation">
<a role="menuitem" lang="es_419"
>Español – América Latina</a>
</li>
<li role="presentation">
<a role="menuitem" lang="fr"
>Français</a>
</li>
<li role="presentation">
<a role="menuitem" lang="id"
>Indonesia</a>
</li>
<li role="presentation">
<a role="menuitem" lang="it"
>Italiano</a>
</li>
<li role="presentation">
<a role="menuitem" lang="pl"
>Polski</a>
</li>
<li role="presentation">
<a role="menuitem" lang="pt_br"
>Português – Brasil</a>
</li>
<li role="presentation">
<a role="menuitem" lang="sq"
>Shqip</a>
</li>
<li role="presentation">
<a role="menuitem" lang="vi"
>Tiếng Việt</a>
</li>
<li role="presentation">
<a role="menuitem" lang="tr"
>Türkçe</a>
</li>
<li role="presentation">
<a role="menuitem" lang="ru"
>Русский</a>
</li>
<li role="presentation">
<a role="menuitem" lang="he"
>עברית</a>
</li>
<li role="presentation">
<a role="menuitem" lang="ar"
>العربيّة</a>
</li>
<li role="presentation">
<a role="menuitem" lang="fa"
>فارسی</a>
</li>
<li role="presentation">
<a role="menuitem" lang="hi"
>हिंदी</a>
</li>
<li role="presentation">
<a role="menuitem" lang="bn"
>বাংলা</a>
</li>
<li role="presentation">
<a role="menuitem" lang="th"
>ภาษาไทย</a>
</li>
<li role="presentation">
<a role="menuitem" lang="zh_cn"
>中文 – 简体</a>
</li>
<li role="presentation">
<a role="menuitem" lang="zh_tw"
>中文 – 繁體</a>
</li>
<li role="presentation">
<a role="menuitem" lang="ja"
>日本語</a>
</li>
<li role="presentation">
<a role="menuitem" lang="ko"
>한국어</a>
</li>
</ul>
</devsite-language-selector>
<devsite-user
enable-profiles
id="devsite-user">
<span class="button devsite-top-button" aria-hidden="true" visually-hidden>Sign in</span>
</devsite-user>
</div>
</div>
</div>
<div class="devsite-collapsible-section
">
<div class="devsite-header-background">
<div class="devsite-product-id-row"
>
<div class="devsite-product-description-row">
<div class="devsite-product-id">
<ul class="devsite-breadcrumb-list"
>
<li class="devsite-breadcrumb-item
">
<a href="https://ai.google.dev/gemma"
class="devsite-breadcrumb-link gc-analytics-event"
data-category="Site-Wide Custom Events"
data-label="Lower Header"
data-value="1"
track-type="globalNav"
track-name="breadcrumb"
track-metadata-position="1"
track-metadata-eventdetail="Gemma"
>
Gemma
</a>
</li>
</ul>
</div>
</div>
</div>
<div class="devsite-doc-set-nav-row">
<devsite-tabs class="lower-tabs">
<nav class="devsite-tabs-wrapper" aria-label="Lower tabs">
<tab >
<a href="https://deepmind.google/models/gemma"
class="devsite-tabs-content gc-analytics-event "
track-metadata-eventdetail="https://deepmind.google/models/gemma"
track-type="nav"
track-metadata-position="nav - gemma"
track-metadata-module="primary nav"
data-category="Site-Wide Custom Events"
data-label="Tab: Gemma"
track-name="gemma"
>
Gemma
</a>
</tab>
<tab class="devsite-active">
<a href="https://ai.google.dev/gemma/docs"
class="devsite-tabs-content gc-analytics-event "
track-metadata-eventdetail="https://ai.google.dev/gemma/docs"
track-type="nav"
track-metadata-position="nav - docs"
track-metadata-module="primary nav"
aria-label="Docs, selected"
data-category="Site-Wide Custom Events"
data-label="Tab: Docs"
track-name="docs"
>
Docs
</a>
</tab>
</nav>
</devsite-tabs>
</div>
</div>
</div>
</div>
</devsite-header>
<devsite-book-nav scrollbars >
<div class="devsite-book-nav-filter"
hidden>
<span class="filter-list-icon material-icons" aria-hidden="true"></span>
<input type="text"
placeholder="Filter"
aria-label="Type to filter"
role="searchbox">
<span class="filter-clear-button hidden"
data-title="Clear filter"
aria-label="Clear filter"
role="button"
tabindex="0"></span>
</div>
<nav class="devsite-book-nav devsite-nav nocontent" data-nosnippet
aria-label="Side menu">
<div class="devsite-mobile-header">
<button type="button"
id="devsite-close-nav"
class="devsite-header-icon-button button-flat material-icons gc-analytics-event"
data-category="Site-Wide Custom Events"
data-label="Close navigation"
aria-label="Close navigation">
</button>
<div class="devsite-product-name-wrapper">
<a href="/" class="devsite-site-logo-link gc-analytics-event"
data-category="Site-Wide Custom Events" data-label="Site logo" track-type="globalNav"
track-name="googleAIForDevelopers" track-metadata-position="nav"
track-metadata-eventDetail="nav">
<picture>
<source srcset="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/lockup-dark-theme-new.svg"
media="(prefers-color-scheme: dark)"
class="devsite-dark-theme">
<img src="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/lockup-new.svg" class="devsite-site-logo" alt="Google AI for Developers">
</picture>
</a>
</div>
</div>
<div class="devsite-book-nav-wrapper">
<div class="devsite-mobile-nav-top">
<ul class="devsite-nav-list">
<li class="devsite-nav-item">
<a href="https://deepmind.google/models/gemma"
class="devsite-nav-title gc-analytics-event
devsite-nav-active"
data-category="Site-Wide Custom Events"
data-label="Tab: Models"
track-name="models"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Models"
track-type="globalNav"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Models
</span>
</a>
<ul class="devsite-nav-responsive-tabs devsite-nav-has-menu
">
<li class="devsite-nav-item">
<span
class="devsite-nav-title"
tooltip
data-category="Site-Wide Custom Events"
data-label="Tab: Models"
track-name="models"
>
<span class="devsite-nav-text" tooltip menu="Models">
More
</span>
<span class="devsite-nav-icon material-icons" data-icon="forward"
menu="Models">
</span>
</span>
</li>
</ul>
<ul class="devsite-nav-responsive-tabs">
<li class="devsite-nav-item">
<a href="https://deepmind.google/models/gemma"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Tab: Gemma"
track-name="gemma"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Gemma"
track-type="globalNav"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Gemma
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/gemma/docs"
class="devsite-nav-title gc-analytics-event
devsite-nav-active"
data-category="Site-Wide Custom Events"
data-label="Tab: Docs"
track-name="docs"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Docs"
track-type="globalNav"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip menu="_book">
Docs
</span>
</a>
</li>
</ul>
</li>
<li class="devsite-nav-item">
<span
class="devsite-nav-title"
tooltip
data-category="Site-Wide Custom Events"
data-label="Tab: Solutions"
track-name="solutions"
>
<span class="devsite-nav-text" tooltip >
Solutions
</span>
</span>
<ul class="devsite-nav-responsive-tabs devsite-nav-has-menu
">
<li class="devsite-nav-item">
<span
class="devsite-nav-title"
tooltip
data-category="Site-Wide Custom Events"
data-label="Tab: Solutions"
track-name="solutions"
>
<span class="devsite-nav-text" tooltip menu="Solutions">
More
</span>
<span class="devsite-nav-icon material-icons" data-icon="forward"
menu="Solutions">
</span>
</span>
</li>
</ul>
</li>
<li class="devsite-nav-item">
<span
class="devsite-nav-title"
tooltip
data-category="Site-Wide Custom Events"
data-label="Tab: Code assistance"
track-name="code assistance"
>
<span class="devsite-nav-text" tooltip >
Code assistance
</span>
</span>
<ul class="devsite-nav-responsive-tabs devsite-nav-has-menu
">
<li class="devsite-nav-item">
<span
class="devsite-nav-title"
tooltip
data-category="Site-Wide Custom Events"
data-label="Tab: Code assistance"
track-name="code assistance"
>
<span class="devsite-nav-text" tooltip menu="Code assistance">
More
</span>
<span class="devsite-nav-icon material-icons" data-icon="forward"
menu="Code assistance">
</span>
</span>
</li>
</ul>
</li>
<li class="devsite-nav-item">
<span
class="devsite-nav-title"
tooltip
data-category="Site-Wide Custom Events"
data-label="Tab: Community"
track-name="community"
>
<span class="devsite-nav-text" tooltip >
Community
</span>
</span>
<ul class="devsite-nav-responsive-tabs devsite-nav-has-menu
">
<li class="devsite-nav-item">
<span
class="devsite-nav-title"
tooltip
data-category="Site-Wide Custom Events"
data-label="Tab: Community"
track-name="community"
>
<span class="devsite-nav-text" tooltip menu="Community">
More
</span>
<span class="devsite-nav-icon material-icons" data-icon="forward"
menu="Community">
</span>
</span>
</li>
</ul>
</li>
</ul>
</div>
<div class="devsite-mobile-nav-bottom">
<ul class="devsite-nav-list" menu="_book">
<li class="devsite-nav-item"><a href="/gemma/docs"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/get_started"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Get started</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/releases"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Releases</span></a></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Models</span>
</div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Core Gemma</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/core"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item
devsite-nav-new"><a href="/gemma/docs/core/model_card_4"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemma 4 model card</span><span class="devsite-nav-icon material-icons"
data-icon="new"
data-title="New!"
aria-hidden="true"></span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/core/model_card_3"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemma 3 model card</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/core/model_card_2"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemma 2 model card</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/core/model_card"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemma 1 model card</span></a></li></ul></div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Core Variants</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Gemma 3n</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/gemma-3n"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/gemma-3n/model_card"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Model card</span></a></li></ul></div></li><li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>FunctionGemma</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/functiongemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/functiongemma/model_card"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Model card</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/functiongemma/formatting-and-best-practices"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Formatting and best practices</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/functiongemma/function-calling-with-hf"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Function calling with Hugging Face Transformers</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/functiongemma/full-function-calling-sequence-with-functiongemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Full function calling sequence with FunctionGemma</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/functiongemma/finetuning-with-functiongemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Fine-tune FunctionGemma</span></a></li></ul></div></li><li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>EmbeddingGemma</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/embeddinggemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/embeddinggemma/model_card"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Model card</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/embeddinggemma/inference-embeddinggemma-with-sentence-transformers"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Generate embeddings with Sentence Transformers</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/embeddinggemma/fine-tuning-embeddinggemma-with-sentence-transformers"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Fine-tune EmbeddingGemma</span></a></li></ul></div></li><li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>PaliGemma</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/paligemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/paligemma/model-card-2"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>v2 model card</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/paligemma/model-card"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>v1 model card</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/paligemma/inference-with-keras"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Generate output with Keras</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/paligemma/fine-tuning-paligemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Fine-tune with JAX and Flax</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/paligemma/prompt-system-instructions"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Prompt and system instructions</span></a></li></ul></div></li><li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>ShieldGemma</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/shieldgemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/shieldgemma/model_card_2"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>ShieldGemma 2 Model card</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/shieldgemma/model_card"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>ShieldGemma 1 Model card</span></a></li></ul></div></li></ul></div></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Run Gemma</span>
</div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Fundamentals</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/run"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item
devsite-nav-new"><a href="/gemma/docs/core/prompt-formatting-gemma4"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Prompt Formatting</span><span class="devsite-nav-icon material-icons"
data-icon="new"
data-title="New!"
aria-hidden="true"></span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/setup"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Legacy Gemma setup [Gemma 1, 2, and 3]</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/core/prompt-structure"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Legacy Prompt and system instructions [Gemma 1, 2, and 3]</span></a></li></ul></div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Run locally with a Chat UI or integrate via API</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/integrations/lmstudio"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>LM Studio</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/integrations/ollama"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Ollama</span></a></li></ul></div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Run efficiently on Edge</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/edge/litert-lm/overview"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>LiteRT-LM</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/integrations/llamacpp"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Llama.cpp</span></a></li><li class="devsite-nav-item"><a href="/edge/mediapipe/solutions/genai/llm_inference"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>MediaPipe LLM Inference API</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/integrations/mlx"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>MLX</span></a></li></ul></div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Build/Train in Python</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/core/gemma_library"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemma library</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/core/huggingface_inference"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Hugging Face Transformers</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/core/keras_inference"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Keras</span></a></li><li class="devsite-nav-item
devsite-nav-external"><a href="https://unsloth.ai/docs/models/gemma-4/train"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Unsloth</span><span class="devsite-nav-icon material-icons"
data-icon="external"
data-title="External"
aria-hidden="true"></span></a></li></ul></div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Deploy to Production / Enterprise</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/core/gemma_on_gemini_api"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemini API</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/core/gke"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Cloud GKE</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/core/deploy_to_cloud_run_from_ai_studio"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Cloud Run</span></a></li><li class="devsite-nav-item
devsite-nav-external"><a href="https://docs.cloud.google.com/vertex-ai/generative-ai/docs/open-models/use-gemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Vertex AI</span><span class="devsite-nav-icon material-icons"
data-icon="external"
data-title="External"
aria-hidden="true"></span></a></li><li class="devsite-nav-item
devsite-nav-external"><a href="https://docs.cloud.google.com/kubernetes-engine/docs/tutorials/serve-gemma-gpu-vllm"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>vLLM</span><span class="devsite-nav-icon material-icons"
data-icon="external"
data-title="External"
aria-hidden="true"></span></a></li></ul></div></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Core Capabilities</span>
</div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Text</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/capabilities/text/basic"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Basic and multi-turn chat</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/capabilities/text/function-calling-gemma4"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Function calling</span></a></li></ul></div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>Visual data</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/capabilities/vision"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/capabilities/vision/image"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Image understanding</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/capabilities/vision/video"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Video understanding</span></a></li></ul></div></li>
<li class="devsite-nav-item"><a href="/gemma/docs/capabilities/audio"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Audio data</span></a></li>
<li class="devsite-nav-item
devsite-nav-new"><a href="/gemma/docs/capabilities/thinking"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Thinking</span><span class="devsite-nav-icon material-icons"
data-icon="new"
data-title="New!"
aria-hidden="true"></span></a></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Tuning guides</span>
</div></li>
<li class="devsite-nav-item"><a href="/gemma/docs/tune"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li>
<li class="devsite-nav-item
devsite-nav-external"><a href="https://gemma-llm.readthedocs.io/en/latest/colab_finetuning.html"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Tune using Gemma library</span><span class="devsite-nav-icon material-icons"
data-icon="external"
data-title="External"
aria-hidden="true"></span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/core/huggingface_text_finetune_qlora"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Tune using Hugging Face Transformers and QLoRA</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/core/huggingface_vision_finetune_qlora"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Vision Tune using Hugging Face Transformers and QLoRA</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/core/huggingface_text_full_finetune"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Full model fine-tune using Hugging Face Transformers</span></a></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Conversion guides</span>
</div></li>
<li class="devsite-nav-item"><a href="/gemma/docs/conversions/hf-to-mediapipe-task"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Convert Hugging Face Safetensors to MediaPipe Task</span></a></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Deployment guides</span>
</div></li>
<li class="devsite-nav-item"><a href="/gemma/docs/integrations/web"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Web</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/integrations/mobile"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Mobile</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/integrations/google-cloud"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Google Cloud</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/integrations/langchain"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>LangChain</span></a></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Research and tools</span>
</div></li>
<li class="devsite-nav-item
devsite-nav-expandable"><div class="devsite-expandable-nav">
<a class="devsite-nav-toggle" aria-hidden="true"></a><div class="devsite-nav-title devsite-nav-title-no-path" tabindex="0" role="button">
<span class="devsite-nav-text" tooltip>RecurrentGemma</span>
</div><ul class="devsite-nav-section"><li class="devsite-nav-item"><a href="/gemma/docs/recurrentgemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Overview</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/recurrentgemma/recurrentgemma_jax_inference"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Inference using JAX and Flax</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/recurrentgemma/recurrentgemma_jax_finetune"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Fine-tune using JAX and Flax</span></a></li><li class="devsite-nav-item"><a href="/gemma/docs/recurrentgemma/model_card"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Model card</span></a></li></ul></div></li>
<li class="devsite-nav-item"><a href="/gemma/docs/datagemma"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>DataGemma</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/gemma_scope"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemma Scope</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/gemma-aps"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemma-APS</span></a></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Community</span>
</div></li>
<li class="devsite-nav-item"><a href="https://deepmind.google/models/gemma/gemmaverse/"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemmaverse</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/docs/discord"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Discord</span></a></li>
<li class="devsite-nav-item
devsite-nav-heading"><div class="devsite-nav-title devsite-nav-title-no-path">
<span class="devsite-nav-text" tooltip>Legal</span>
</div></li>
<li class="devsite-nav-item"><a href="/gemma/terms"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Terms of use</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/apache_2"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Gemma 4 license</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/prohibited_use_policy"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Prohibited use</span></a></li>
<li class="devsite-nav-item"><a href="/gemma/intended_use_statement"
class="devsite-nav-title"
><span class="devsite-nav-text" tooltip>Intended use statement</span></a></li>
</ul>
<ul class="devsite-nav-list" menu="Models"
aria-label="Side menu" hidden>
<li class="devsite-nav-item devsite-nav-heading">
<span
class="devsite-nav-title"
tooltip
>
<span class="devsite-nav-text" tooltip >
Gemini
</span>
</span>
</li>
<li class="devsite-nav-item">
<a href="https://deepmind.google/gemini"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: About"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
About
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/gemini-api/docs"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Docs"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Docs
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/api"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: API reference"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
API reference
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/pricing"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Pricing"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Pricing
</span>
</a>
</li>
<li class="devsite-nav-item devsite-nav-heading">
<span
class="devsite-nav-title"
tooltip
>
<span class="devsite-nav-text" tooltip >
Imagen
</span>
</span>
</li>
<li class="devsite-nav-item">
<a href="https://deepmind.google/technologies/imagen/"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: About"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
About
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/gemini-api/docs/imagen"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Docs"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Docs
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/pricing"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Pricing"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Pricing
</span>
</a>
</li>
<li class="devsite-nav-item devsite-nav-heading">
<span
class="devsite-nav-title"
tooltip
>
<span class="devsite-nav-text" tooltip >
Veo
</span>
</span>
</li>
<li class="devsite-nav-item">
<a href="https://deepmind.google/technologies/veo/veo-2/"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: About"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
About
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/gemini-api/docs/video"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Docs"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Docs
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/pricing"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Pricing"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Pricing
</span>
</a>
</li>
<li class="devsite-nav-item devsite-nav-heading">
<span
class="devsite-nav-title"
tooltip
>
<span class="devsite-nav-text" tooltip >
Gemma
</span>
</span>
</li>
<li class="devsite-nav-item">
<a href="https://deepmind.google/models/gemma"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: About"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
About
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/gemma/docs"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Docs"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Docs
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/gemma/gemmaverse"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Gemmaverse"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Gemmaverse
</span>
</a>
</li>
</ul>
<ul class="devsite-nav-list" menu="Solutions"
aria-label="Side menu" hidden>
<li class="devsite-nav-item devsite-nav-heading">
<span
class="devsite-nav-title"
tooltip
>
<span class="devsite-nav-text" tooltip >
Build with Gemini
</span>
</span>
</li>
<li class="devsite-nav-item">
<a href="/gemini-api/docs"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Gemini API"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Gemini API
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://aistudio.google.com"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Google AI Studio"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Google AI Studio
</span>
</a>
</li>
<li class="devsite-nav-item devsite-nav-heading">
<span
class="devsite-nav-title"
tooltip
>
<span class="devsite-nav-text" tooltip >
Customize Gemma open models
</span>
</span>
</li>
<li class="devsite-nav-item">
<a href="/gemma"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Gemma open models"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Gemma open models
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://keras.io/keras_3/"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Multi-framework with Keras"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Multi-framework with Keras
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://colab.sandbox.google.com/github/google/generative-ai-docs/blob/main/site/en/gemma/docs/lora_tuning.ipynb"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Fine-tune in Colab"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Fine-tune in Colab
</span>
</a>
</li>
<li class="devsite-nav-item devsite-nav-heading">
<span
class="devsite-nav-title"
tooltip
>
<span class="devsite-nav-text" tooltip >
Run on-device
</span>
</span>
</li>
<li class="devsite-nav-item">
<a href="/edge"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Google AI Edge"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Google AI Edge
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://developer.android.com/ai/gemini-nano"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Gemini Nano on Android"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Gemini Nano on Android
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://developer.chrome.com/docs/ai/built-in"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Chrome built-in web APIs"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Chrome built-in web APIs
</span>
</a>
</li>
<li class="devsite-nav-item devsite-nav-heading">
<span
class="devsite-nav-title"
tooltip
>
<span class="devsite-nav-text" tooltip >
Build responsibly
</span>
</span>
</li>
<li class="devsite-nav-item">
<a href="/responsible"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Responsible GenAI Toolkit"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Responsible GenAI Toolkit
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://saif.google"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Secure AI Framework"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Secure AI Framework
</span>
</a>
</li>
</ul>
<ul class="devsite-nav-list" menu="Code assistance"
aria-label="Side menu" hidden>
<li class="devsite-nav-item">
<a href="https://developer.android.com/gemini-in-android"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Android Studio"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Android Studio
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://developer.chrome.com/docs/devtools/console/understand-messages"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Chrome DevTools"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Chrome DevTools
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://colab.google"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Colab"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Colab
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://firebase.google.com/products/generative-ai"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Firebase"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Firebase
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://cloud.google.com/products/gemini/code-assist"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Google Cloud"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Google Cloud
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://plugins.jetbrains.com/plugin/8079-google-cloud-code"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: JetBrains"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
JetBrains
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://labs.google.com/jules/home"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Jules"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Jules
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="https://marketplace.visualstudio.com/items?itemName=GoogleCloudTools.cloudcode"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: VS Code"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
VS Code
</span>
</a>
</li>
</ul>
<ul class="devsite-nav-list" menu="Community"
aria-label="Side menu" hidden>
<li class="devsite-nav-item">
<a href="https://discuss.ai.google.dev"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Google AI Forum"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Google AI Forum
</span>
</a>
</li>
<li class="devsite-nav-item">
<a href="/gemini-api/docs/gemini-for-research"
class="devsite-nav-title gc-analytics-event
"
data-category="Site-Wide Custom Events"
data-label="Responsive Tab: Gemini for Research"
track-type="navMenu"
track-metadata-eventDetail="globalMenu"
track-metadata-position="nav">
<span class="devsite-nav-text" tooltip >
Gemini for Research
</span>
</a>
</li>
</ul>
</div>
</div>
</nav>
</devsite-book-nav>
<section id="gc-wrapper">
<main role="main" id="main-content" class="devsite-main-content"
has-book-nav
has-sidebar
>
<div class="devsite-sidebar">
<div class="devsite-sidebar-content">
<devsite-toc class="devsite-nav"
role="navigation"
aria-label="On this page"
depth="2"
scrollbars
data-nosnippet
></devsite-toc>
<devsite-recommendations-sidebar class="nocontent devsite-nav" data-nosnippet>
</devsite-recommendations-sidebar>
</div>
</div>
<devsite-content>
<article class="devsite-article"><style>
/* Styles inlined from /site-assets/css/style.css */
body[theme="googledevai-theme"] {
--devsite-background-0: var(--devsite-background-1);
--devsite-button-border: 1px solid #747775;
--devsite-button-border-radius: 20rem;
--devsite-button-font: 500 14px/36px 'Google Sans Text', Roboto, sans-serif;
--devsite-code-font-family: 'Google Sans Mono', Roboto Mono, monospace;
--devsite-primary-font-family: 'Google Sans Text', Roboto, sans-serif;
--devsite-table-heading-font: 500 14px/20px 'Google Sans Text', Roboto, sans-serif;
--googledevai-border-color: #c4c7c5;
--googledevai-blue-light: #d7e6ff;
--googledevai-blue-dark: #2e64de;
--googledevai-cyan-light: #c7e4ff;
--googledevai-cyan-dark: #3c8fe3;
--googledevai-purple-light: #dce2ff;
--googledevai-purple-dark: #987be9;
--googledevai-purple: #ac87eb;
--googledevai-red: #ee4d5d;
--googledevai-secondary-text: #001d35;
--googledevai-button-gradient-light: linear-gradient(90deg, var(--googledevai-blue-light), var(--googledevai-cyan-light), var(--googledevai-purple-light));
--googledevai-button-gradient-dark: linear-gradient(90deg, var(--googledevai-blue), var(--googledevai-cyan), var(--googledevai-purple));
}
body[theme="googledevai-theme"]:not([type="reference"]){
--googledevai-page-width: 1100px;
}
body[layout=docs][theme="googledevai-theme"]:not([type="reference"]) .devsite-main-content,
body[layout=docs][theme="googledevai-theme"]:not([type="reference"]) .devsite-main-content[has-book-nav][has-sidebar] {
grid-template-columns: minmax(269px, 1fr) minmax(752px, var(--googledevai-page-width)) minmax(160px, 1fr);
grid-gap: 3rem;
}
body[layout=docs][theme="googledevai-theme"] devsite-content {
max-width: var(--googledevai-page-width);
}
body[layout=docs][theme="googledevai-theme"] .devsite-article {
box-shadow: unset;
}
body[theme="googledevai-theme"] {
--googledevai-header-gradient: linear-gradient(90deg, var(--googledevai-blue) 50%, var(--googledevai-cyan), var(--googledevai-purple), var(--googledevai-red));
}
body[theme="googledevai-theme"].color-scheme--dark {
--googledevai-header-gradient: linear-gradient(90deg, var(--googledevai-blue) 75%, var(--googledevai-cyan), var(--googledevai-purple));
--googledevai-border-color: #444746;
}
/* Ensure that full-bleed pages get the full width. */
body[theme="googledevai-theme"][layout="full"] .devsite-main-content {
max-width: none;
padding: 0;
}
/* And ensure that any site banners/ACL warnings/etc don't get hidden on
* full-bleed pages. */
body[theme="googledevai-theme"][layout="full"] .devsite-banner {
margin: 0;
}
tab:has(> a.hidden-tab) {
display: none;
}
body[theme="googledevai-theme"] devsite-toc > .devsite-nav-list {
border-inline-start: unset;
}
/* Banner notice */
[layout=docs] .devsite-banner:first-of-type {
background: var(--googledevai-cyan-light);
border-radius: 10px;
color: var(--googledevai-secondary-text);
margin: -2.5rem -0.25rem 2.5rem;
display: flex;
}
/* Banner notice smaller screens */
@media (max-width: 840px) {
[layout=docs] .devsite-banner:first-of-type {
margin: -0.25rem -0.25rem 2.5rem;
}
}
/* Asides */
.devsite-article-body>aside:not([class*=attempt]) {
border-radius: 2px;
}
/* Tables */
table:not(.tfo-notebook-buttons) {
border: 1px solid var(--googledevai-border-color);
border-collapse: unset;
border-radius: 9px;
margin: auto;
width: 100%;
}
.gemini-api-model-table tr:not(:last-child) td:not(:first-child),
.gemini-api-model-table tr:not(:last-child) th,
th,
table:not(.gemini-api-model-table):not(.tfo-notebook-buttons) tr:not(:last-child) td {
border-bottom: 1px solid var(--googledevai-border-color);
}
th,
td {
background: transparent;
padding: 1rem;
}
/* Notebooks */
devsite-code .tfo-notebook-code-cell-output {
max-height: 300px;
overflow: auto;
background: rgba(237, 247, 255, 1); /* blue bg to distinguish from input code cells */
}
devsite-code .tfo-notebook-code-cell-output + .devsite-code-buttons-container button {
background: rgba(237, 247, 255, .7); /* blue bg to distinguish from input code cells */
}
.color-scheme--dark devsite-code .tfo-notebook-code-cell-output {
background: rgba(var(--devsite-background-2), 1);
}
.color-scheme--dark devsite-code .tfo-notebook-code-cell-output + .devsite-code-buttons-container button {
background: rgba(var(--devsite-background-2), .7);
}
devsite-code[dark-code] .tfo-notebook-code-cell-output {
background: rgba(64, 78, 103, 1); /* medium slate */
}
devsite-code[dark-code] .tfo-notebook-code-cell-output + .devsite-code-buttons-container button {
background: rgba(64, 78, 103, .7); /* medium slate */
}
.devsite-article-body>devsite-code {
--devsite-code-buttons-container-right: 0;
--devsite-code-margin: 0 0;
--devsite-code-padding-block: 14px;
border-radius: 8px;
}
.devsite-article-body>.beta:not([class*=attempt]),
.devsite-article-body>.caution:not([class*=attempt]),
.devsite-article-body>.deprecated:not([class*=attempt]),
.devsite-article-body>.dogfood:not([class*=attempt]),
.devsite-article-body>.experimental:not([class*=attempt]),
.devsite-article-body>.key-point:not([class*=attempt]),
.devsite-article-body>.key-term:not([class*=attempt]),
.devsite-article-body>.note:not([class*=attempt]),
.devsite-article-body>.objective:not([class*=attempt]),
.devsite-article-body>.preview:not([class*=attempt]),
.devsite-article-body>.special:not([class*=attempt]),
.devsite-article-body>.success:not([class*=attempt]),
.devsite-article-body>.tip:not([class*=attempt]),
.devsite-article-body>.warning:not([class*=attempt]),
.devsite-article-body>aside:not([class*=attempt]) {
--devsite-notice-margin: 0 0;
border-radius: 8px;
}
/* override default table styles for notebook buttons */
.devsite-table-wrapper .tfo-notebook-buttons {
display: block;
width: auto;
}
.tfo-notebook-buttons td {
display: inline-block;
padding: 0 16px 16px 0;
}
/* from DevSite's buttons.scss */
.tfo-notebook-buttons a,
.tfo-notebook-buttons :link,
.tfo-notebook-buttons :visited {
-moz-appearance: none;
-webkit-appearance: none;
-webkit-box-align: center;
-ms-flex-align: center;
align-items: center;
align-self: var(--devsite-button-align-self);
background: var(--devsite-button-background, var(--devsite-background-1));
border: var(--devsite-button-border, 0);
border-radius: var(--devsite-button-border-radius, 2px);
box-sizing: border-box;
color: var(--devsite-button-color);
cursor: pointer;
display: -webkit-box;
display: -ms-flexbox;
display: flex;
font: var(--devsite-button-font, 500 14px/36px var(--devsite-primary-font-family));
height: var(--devsite-button-height, 36px);
letter-spacing: var(--devsite-button-letter-spacing, 0);
line-height: var(--devsite-button-line-height, 36px);
margin: var(--devsite-button-margin, 0);
margin-inline-end: var(--devsite-button-margin-x-end);
max-width: var(--devsite-button-max-width, none);
min-width: 36px;
outline: 0;
overflow: hidden;
padding: var(--devsite-button-with-icon-padding, 0 16px);
text-align: center;
text-decoration: none;
text-overflow: ellipsis;
text-transform: var(--devsite-button-text-transform, uppercase);
transition:
background-color .2s,
border .2s;
vertical-align: middle;
white-space: nowrap;
width: var(--devsite-button-width, auto);
}
.tfo-notebook-buttons a:hover,
.tfo-notebook-buttons a:focus {
background: var(--devsite-button-background-hover);
border: var(--devsite-button-border-hover, 0);
color: var(--devsite-button-color-hover, var(--devsite-button-color));
text-decoration: var(--devsite-button-text-decoration-hover, none);
}
.tfo-notebook-buttons a:active {
background: var(--devsite-button-background-active);
border: var(--devsite-button-border-active, 0);
transform: var(--devsite-button-transform-active, none);
}
.tfo-notebook-buttons tr {
background: 0;
border: 0;
}
/* on rendered notebook page,
remove link to webpage since we're already here */
.tfo-notebook-buttons:not(.tfo-api) td:first-child {
display: none;
}
.tfo-notebook-buttons td > a > img {
margin: 0 8px 0 -4px;
height: 20px;
}
[appearance='dark'] .tfo-notebook-buttons td > a > img {
filter: invert(1);
}
@media (prefers-color-scheme: dark) {
[appearance='device'] .tfo-notebook-buttons td > a > img {
filter: invert(1);
}
.sub-heading {
background-color: #333;
color: #bdbdbd;
}
}
[appearance='dark'] .sub-heading {
background-color: #333;
color: #bdbdbd;
}
.sub-heading {
background-color: #f2f2f2;
color: #5f6368;
}
@media screen and (max-width: 600px) {
.tfo-notebook-buttons td {
display: block;
}
}
devsite-nav-buttons button {
margin-left: 0;
margin-top: 5px;
}
code {
border-radius: 6px
}
devsite-book-nav .devsite-nav-list>.devsite-nav-heading:not(.devsite-nav-divider) {
border-top: 0;
padding-bottom: 0.9rem;
font-size: 1rem;
}
/*
* TODO(b/439059414): Remove this workaround in favor of a project-level
* body_class when possible.
*/
.ais-theme-marker {
display: none;
}
/*
* Gemini API body class.
* https://source.corp.google.com/piper///depot/google3/third_party/devsite/googledevai/en/gemini-api/_project.yaml;l=7
*/
.gemini-api devsite-thumb-rating[position="header"],
.gemini-api devsite-feedback[position="header"] {
/* Hide the thumb rating and feedback widgets at the top of the page. */
display: none;
}
/*
* Shaded table styles look like a .pricing-table but are more flexible around
* content sizes in each column.
*/
.shaded-table {
border-collapse: separate;
border-spacing: 0;
border-radius: 8px;
overflow: hidden;
}
.shaded-table th {
background-color: #f2f2f2;
text-align: left;
padding: 8px;
}
/* These should use theme colours for light too, so we don't
* need an override. */
.color-scheme--dark .shaded-table th {
background-color: var(--devsite-ref-palette--grey800);
}
.shaded-table td {
padding: 8px;
}
.shaded-table th:first-child {
border-top-left-radius: 8px;
}
.shaded-table th:last-child {
border-top-right-radius: 8px;
}
.shaded-table tr:last-child td:first-child {
border-bottom-left-radius: 8px;
}
.shaded-table tr:last-child td:last-child {
border-bottom-right-radius: 8px;
}
.devsite-nav {
font-size: var(--devsite-nav-font-size, 14px);
}
.devsite-nav-item {
line-height: var(--devsite-nav-item-line-height, 20px);
}
.devsite-book-nav-bg, devsite-book-nav {
width: 210px;
scrollbar-width: thin;
}
/* Hide the old toggle button immediately */
.devsite-expandable-nav > .devsite-nav-toggle {
display: none !important;
}
/* Ion setup: Default State (Chevron Right) */
.devsite-expandable-nav > .devsite-nav-title::after {
font-family: 'Material Icons';
font-weight: normal;
font-style: normal;
font-size: 18px;
line-height: 1;
color: #888;
/* Default: Chevron Right */
content: "\e5cc";
flex-shrink: 0;
margin-left: 8px;
}
/* Down state logic */
.devsite-expandable-nav.expanded > .devsite-nav-title::after,
.devsite-expandable-nav:has(.devsite-nav-active) > .devsite-nav-title::after,
.devsite-expandable-nav > .devsite-nav-title[aria-expanded="true"]::after {
content: "\e313";
}
/* Close state logic */
.devsite-expandable-nav > .devsite-nav-title[aria-expanded="false"]::after {
content: "\e5cc" !important;
}
/* Hovercard styling */
.gemini-api .heading:has(devsite-gemini-api-hovercard-button) {
display: flex;
justify-content: space-between;
align-items: center;
}
.gemini-api .heading:has(devsite-gemini-api-hovercard-button) h1 {
margin-bottom: 0;
}
devsite-gemini-api-hovercard,
devsite-gemini-api-hovercard-button {
/* Render above any code blocks on the page */
z-index: 1;
}
.devsite-nav-icon[data-icon="beta"], .devsite-nav-icon[data-icon="preview"],
.devsite-nav-icon[data-icon="experimental"] {
margin: -5px 0 -1px 4px;
}
</style><style>
/* Styles inlined from /site-assets/css/gemma.css */
body[theme="googledevai-theme"] {
--googledevai-header-gradient: linear-gradient(90deg, var(--googledevai-blue) 75%, var(--googledevai-cyan), #acb7ff) !important;
}
</style>
<div class="devsite-banner devsite-banner-announcement nocontent" data-nosnippet
>
<div class="devsite-banner-message">
<div class="devsite-banner-message-text">
<b>Gemma 4</b> released with text, audio and image input and long up to 256K context window! <a href="/gemma/docs/core"><b>Learn more</b></a>
</div>
</div>
</div>
<div class="devsite-article-meta nocontent" role="navigation" data-nosnippet>
<ul class="devsite-breadcrumb-list"
aria-label="Breadcrumb">
<li class="devsite-breadcrumb-item
">
<a href="https://ai.google.dev/"
class="devsite-breadcrumb-link gc-analytics-event"
data-category="Site-Wide Custom Events"
data-label="Breadcrumbs"
data-value="1"
track-type="globalNav"
track-name="breadcrumb"
track-metadata-position="1"
track-metadata-eventdetail=""
>
Home
</a>
</li>
<li class="devsite-breadcrumb-item
">
<div class="devsite-breadcrumb-guillemet material-icons" aria-hidden="true"></div>
<a href="https://ai.google.dev/gemma"
class="devsite-breadcrumb-link gc-analytics-event"
data-category="Site-Wide Custom Events"
data-label="Breadcrumbs"
data-value="2"
track-type="globalNav"
track-name="breadcrumb"
track-metadata-position="2"
track-metadata-eventdetail="Gemma"
>
Gemma
</a>
</li>
<li class="devsite-breadcrumb-item
">
<div class="devsite-breadcrumb-guillemet material-icons" aria-hidden="true"></div>
<a href="https://deepmind.google/models/gemma"
class="devsite-breadcrumb-link gc-analytics-event"
data-category="Site-Wide Custom Events"
data-label="Breadcrumbs"
data-value="3"
track-type="globalNav"
track-name="breadcrumb"
track-metadata-position="3"
track-metadata-eventdetail=""
>
Models
</a>
</li>
<li class="devsite-breadcrumb-item
">
<div class="devsite-breadcrumb-guillemet material-icons" aria-hidden="true"></div>
<a href="https://ai.google.dev/gemma/docs"
class="devsite-breadcrumb-link gc-analytics-event"
data-category="Site-Wide Custom Events"
data-label="Breadcrumbs"
data-value="4"
track-type="globalNav"
track-name="breadcrumb"
track-metadata-position="4"
track-metadata-eventdetail=""
>
Docs
</a>
</li>
</ul>
<devsite-thumb-rating position="header">
</devsite-thumb-rating>
<devsite-gemini-api-switcher class="nocontent"></devsite-gemini-api-switcher>
</div>
<devsite-feedback
position="header"
project-name="Gemma"
product-id="5292923"
bucket="documentation"
context=""
version="t-devsite-webserver-20260409-r00-rc00.476762697357682131"
data-label="Send Feedback Button"
track-type="feedback"
track-name="sendFeedbackLink"
track-metadata-position="header"
class="nocontent"
data-nosnippet
project-icon="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/touchicon-180-new.png"
>
<button>
Send feedback
</button>
</devsite-feedback>
<h1 class="devsite-page-title" tabindex="-1">
Gemma formatting and system instructions<devsite-actions hidden data-nosnippet>
<devsite-llm-tools></devsite-llm-tools></devsite-actions>
</h1>
<div class="devsite-page-title-meta"><devsite-view-release-notes></devsite-view-release-notes></div>
<devsite-toc class="devsite-nav"
depth="2"
devsite-toc-embedded
>
</devsite-toc>
<div class="devsite-article-body clearfix
">
<p>
</p>
<p>Gemma instruction-tuned (IT) models are trained with a specific <em>formatter</em> that
annotates all instruction tuning examples with extra information, both at
training and inference time. The formatter has two purposes:</p>
<ol>
<li>Indicating roles in a conversation, such as the <em>system</em>, <em>user</em>, or
<em>assistant</em> roles.</li>
<li>Delineating turns in a conversation, especially in a multi-turn
conversation.</li>
</ol>
<p>Below, we specify the control tokens used by Gemma and their use cases. Note
that the control tokens are reserved in and specific to our tokenizer.</p>
<ul>
<li>Token to indicate a user turn: <code translate="no" dir="ltr">user</code></li>
<li>Token to indicate a model turn: <code translate="no" dir="ltr">model</code></li>
<li>Token to indicate the beginning of dialogue turn: <code translate="no" dir="ltr">&lt;start_of_turn&gt;</code></li>
<li>Token to indicate the end of dialogue turn: <code translate="no" dir="ltr">&lt;end_of_turn&gt;</code></li>
</ul>
<p>Here&#39;s an example dialogue:</p>
<div></div><devsite-code><pre class="devsite-click-to-copy" translate="no" dir="ltr" is-upgraded><code translate="no" dir="ltr">&lt;start_of_turn&gt;user
knock knock&lt;end_of_turn&gt;
&lt;start_of_turn&gt;model
who is there&lt;end_of_turn&gt;
&lt;start_of_turn&gt;user
Gemma&lt;end_of_turn&gt;
&lt;start_of_turn&gt;model
Gemma who?&lt;end_of_turn&gt;
</code></pre></devsite-code>
<p>The token <code translate="no" dir="ltr">&quot;&lt;end_of_turn&gt;\n&quot;</code> is the turn separator, and the prompt prefix is
<code translate="no" dir="ltr">&quot;&lt;start_of_turn&gt;model\n&quot;</code>. This means that if you&#39;d like to prompt the model
with a question like, &quot;What is Cramer&#39;s Rule?&quot;, you should instead feed the
model as follows:</p>
<div></div><devsite-code><pre class="devsite-click-to-copy" translate="no" dir="ltr" is-upgraded><code translate="no" dir="ltr">&#34;&lt;start_of_turn&gt;user
What is Cramer&#39;s Rule?&lt;end_of_turn&gt;
&lt;start_of_turn&gt;model&#34;
</code></pre></devsite-code>
<p>Note that if you want to finetune the pretrained Gemma models with your own
data, you can use any such schema for control tokens, as long as it&#39;s consistent
between your training and inference use cases.</p>
<h2 id="system-instructions" data-text="System instructions" tabindex="-1">System instructions</h2>
<p>Gemma&#39;s instruction-tuned models are designed to work with only two roles:
<code translate="no" dir="ltr">user</code> and <code translate="no" dir="ltr">model</code>. Therefore, the <code translate="no" dir="ltr">system</code> role or a system turn is not
supported.</p>
<p>Instead of using a separate system role, provide system-level instructions
directly within the initial user prompt. The model instruction following
capabilities allow Gemma to interpret the instructions effectively. For example:</p>
<div></div><devsite-code><pre class="devsite-click-to-copy" translate="no" dir="ltr" is-upgraded><code translate="no" dir="ltr">&lt;start_of_turn&gt;user
Only reply like a pirate.
What is the answer to life the universe and everything?&lt;end_of_turn&gt;
&lt;start_of_turn&gt;model
Arrr, &#39;tis 42,&lt;end_of_turn&gt;
</code></pre></devsite-code>
<link href="https://fonts.googleapis.com/css2?family=Google+Symbols:opsz,wght,FILL,GRAD@20..48,100..700,0..1,-50..200" rel="stylesheet" data-page-link>
</div>
<devsite-thumb-rating position="footer">
</devsite-thumb-rating>
<devsite-feedback
position="footer"
project-name="Gemma"
product-id="5292923"
bucket="documentation"
context=""
version="t-devsite-webserver-20260409-r00-rc00.476762697357682131"
data-label="Send Feedback Button"
track-type="feedback"
track-name="sendFeedbackLink"
track-metadata-position="footer"
class="nocontent"
data-nosnippet
project-icon="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/touchicon-180-new.png"
>
<button>
Send feedback
</button>
</devsite-feedback>
<div class="devsite-floating-action-buttons"></div></article>
<devsite-content-footer class="nocontent" data-nosnippet>
<p>Except as otherwise noted, the content of this page is licensed under the <a href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 License</a>, and code samples are licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache 2.0 License</a>. For details, see the <a href="https://developers.google.com/site-policies">Google Developers Site Policies</a>. Java is a registered trademark of Oracle and/or its affiliates.</p>
<p>Last updated 2025-03-21 UTC.</p>
</devsite-content-footer>
<devsite-notification
>
</devsite-notification>
<div class="devsite-content-data">
<template class="devsite-thumb-rating-feedback">
<devsite-feedback
position="thumb-rating"
project-name="Gemma"
product-id="5292923"
bucket="documentation"
context=""
version="t-devsite-webserver-20260409-r00-rc00.476762697357682131"
data-label="Send Feedback Button"
track-type="feedback"
track-name="sendFeedbackLink"
track-metadata-position="thumb-rating"
class="nocontent"
data-nosnippet
project-icon="https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/touchicon-180-new.png"
>
<button>
Need to tell us more?
</button>
</devsite-feedback>
</template>
<template class="devsite-content-data-template">
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-03-21 UTC."],[],[]]
</template>
</div>
</devsite-content>
</main>
<devsite-footer-promos class="devsite-footer">
</devsite-footer-promos>
<devsite-footer-linkboxes class="devsite-footer">
<nav class="devsite-footer-linkboxes nocontent"
aria-label="Footer links"
data-nosnippet>
</nav>
</devsite-footer-linkboxes>
<devsite-footer-utility class="devsite-footer">
<div class="devsite-footer-utility nocontent" data-nosnippet>
<nav class="devsite-footer-utility-links" aria-label="Utility links">
<ul class="devsite-footer-utility-list">
<li class="devsite-footer-utility-item
">
<a class="devsite-footer-utility-link gc-analytics-event"
href="//policies.google.com/terms"
data-category="Site-Wide Custom Events"
data-label="Footer Terms link"
>
Terms
</a>
</li>
<li class="devsite-footer-utility-item
">
<a class="devsite-footer-utility-link gc-analytics-event"
href="//policies.google.com/privacy"
data-category="Site-Wide Custom Events"
data-label="Footer Privacy link"
>
Privacy
</a>
</li>
<li class="devsite-footer-utility-item
glue-cookie-notification-bar-control">
<a class="devsite-footer-utility-link gc-analytics-event"
href="#"
data-category="Site-Wide Custom Events"
data-label="Footer Manage cookies link"
aria-hidden="true"
>
Manage cookies
</a>
</li>
</ul>
<devsite-language-selector>
<ul role="presentation">
<li role="presentation">
<a role="menuitem" lang="en"
>English</a>
</li>
<li role="presentation">
<a role="menuitem" lang="de"
>Deutsch</a>
</li>
<li role="presentation">
<a role="menuitem" lang="es_419"
>Español – América Latina</a>
</li>
<li role="presentation">
<a role="menuitem" lang="fr"
>Français</a>
</li>
<li role="presentation">
<a role="menuitem" lang="id"
>Indonesia</a>
</li>
<li role="presentation">
<a role="menuitem" lang="it"
>Italiano</a>
</li>
<li role="presentation">
<a role="menuitem" lang="pl"
>Polski</a>
</li>
<li role="presentation">
<a role="menuitem" lang="pt_br"
>Português – Brasil</a>
</li>
<li role="presentation">
<a role="menuitem" lang="sq"
>Shqip</a>
</li>
<li role="presentation">
<a role="menuitem" lang="vi"
>Tiếng Việt</a>
</li>
<li role="presentation">
<a role="menuitem" lang="tr"
>Türkçe</a>
</li>
<li role="presentation">
<a role="menuitem" lang="ru"
>Русский</a>
</li>
<li role="presentation">
<a role="menuitem" lang="he"
>עברית</a>
</li>
<li role="presentation">
<a role="menuitem" lang="ar"
>العربيّة</a>
</li>
<li role="presentation">
<a role="menuitem" lang="fa"
>فارسی</a>
</li>
<li role="presentation">
<a role="menuitem" lang="hi"
>हिंदी</a>
</li>
<li role="presentation">
<a role="menuitem" lang="bn"
>বাংলা</a>
</li>
<li role="presentation">
<a role="menuitem" lang="th"
>ภาษาไทย</a>
</li>
<li role="presentation">
<a role="menuitem" lang="zh_cn"
>中文 – 简体</a>
</li>
<li role="presentation">
<a role="menuitem" lang="zh_tw"
>中文 – 繁體</a>
</li>
<li role="presentation">
<a role="menuitem" lang="ja"
>日本語</a>
</li>
<li role="presentation">
<a role="menuitem" lang="ko"
>한국어</a>
</li>
</ul>
</devsite-language-selector>
</nav>
</div>
</devsite-footer-utility>
<devsite-panel>
</devsite-panel>
</section>
</section>
<devsite-sitemask></devsite-sitemask>
<devsite-snackbar></devsite-snackbar>
<devsite-tooltip ></devsite-tooltip>
<devsite-heading-link></devsite-heading-link>
<devsite-analytics>
<script type="application/json" analytics>[]</script>
<script type="application/json" tag-management>{&#34;at&#34;: &#34;True&#34;, &#34;ga4&#34;: [], &#34;ga4p&#34;: [], &#34;gtm&#34;: [{&#34;id&#34;: &#34;GTM-TC2MQKS8&#34;, &#34;purpose&#34;: 0}], &#34;parameters&#34;: {&#34;internalUser&#34;: &#34;False&#34;, &#34;language&#34;: {&#34;machineTranslated&#34;: &#34;False&#34;, &#34;requested&#34;: &#34;en&#34;, &#34;served&#34;: &#34;en&#34;}, &#34;pageType&#34;: &#34;article&#34;, &#34;projectName&#34;: &#34;Gemma&#34;, &#34;signedIn&#34;: &#34;False&#34;, &#34;tenant&#34;: &#34;googledevai&#34;, &#34;recommendations&#34;: {&#34;sourcePage&#34;: &#34;&#34;, &#34;sourceType&#34;: 0, &#34;sourceRank&#34;: 0, &#34;sourceIdenticalDescriptions&#34;: 0, &#34;sourceTitleWords&#34;: 0, &#34;sourceDescriptionWords&#34;: 0, &#34;experiment&#34;: &#34;&#34;}, &#34;experiment&#34;: {&#34;ids&#34;: &#34;&#34;}}}</script>
</devsite-analytics>
<devsite-badger></devsite-badger>
<script nonce="MvVos0R5ATePCviNiDsJ+iieyKZUHa">
(function(d,e,v,s,i,t,E){d['GoogleDevelopersObject']=i;
t=e.createElement(v);t.async=1;t.src=s;E=e.getElementsByTagName(v)[0];
E.parentNode.insertBefore(t,E);})(window, document, 'script',
'https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/js/app_loader.js', '[59,"en",null,"/js/devsite_app_module.js","https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec","https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai","https://googledevai-dot-devsite-v2-prod-3p.appspot.com",null,null,["/_pwa/googledevai/manifest.json","https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/images/video-placeholder.svg","https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/favicon-new.png","https://www.gstatic.com/devrel-devsite/prod/v2f052e0cca7362dede225b85c12aee59eabee5b8fbb05d44fc345ffb54861aec/googledevai/images/lockup-new.svg","https://fonts.googleapis.com/css?family=Google+Sans:400,500|Roboto:400,400italic,500,500italic,700,700italic|Roboto+Mono:400,500,700|Inter:400,500|Inter+Tight:300,500,600&display=swap"],1,null,[1,6,8,12,14,17,21,25,50,52,63,70,75,76,80,87,91,92,93,97,98,100,101,102,103,104,105,107,108,109,110,112,113,117,118,120,122,124,125,126,127,129,130,131,132,133,134,135,136,138,140,141,147,148,149,151,152,156,157,158,159,161,163,164,168,169,170,179,180,182,183,186,191,193,196],"AIzaSyCNm9YxQumEXwGJgTDjxoxXK6m1F-9720Q","AIzaSyCc76DZePGtoyUjqKrLdsMGk_ry7sljLbY","ai.google.dev","AIzaSyB9bqgQ2t11WJsOX8qNsCQ6U-w91mmqF-I","AIzaSyAdYnStPdzjcJJtQ0mvIaeaMKj7_t6J_Fg",null,null,null,["BookNav__enable_tenant_cache_key","DevPro__enable_google_one_card","MiscFeatureFlags__enable_explicit_template_dependencies","Profiles__enable_recognition_badges","Cloud__fast_free_trial","MiscFeatureFlags__gdp_dashboard_reskin_enabled","MiscFeatureFlags__developers_footer_dark_image","Cloud__enable_legacy_calculator_redirect","MiscFeatureFlags__enable_explain_this_code","EngEduTelemetry__enable_engedu_telemetry","DevPro__enable_g1_integration","Profiles__enable_user_type","Cloud__enable_cloudx_experiment_ids","Profiles__enable_dashboard_curated_recommendations","MiscFeatureFlags__enable_framebox_badge_methods","MiscFeatureFlags__enable_firebase_utm","Profiles__enable_stripe_subscription_management","Search__enable_page_map","MiscFeatureFlags__enable_llms_txt","Analytics__enable_devpro_interaction_logging","CloudShell__cloud_code_overflow_menu","Search__enable_dynamic_content_confidential_banner","CloudShell__cloud_shell_button","DevPro__enable_devsite_captcha","Search__enable_suggestions_from_borg","MiscFeatureFlags__enable_variable_operator_index_yaml","Cloud__enable_free_trial_server_call","MiscFeatureFlags__enable_appearance_cookies","Profiles__enable_profile_collections","Profiles__enable_completecodelab_endpoint","Profiles__enable_purchase_prompts","Cloud__enable_llm_concierge_chat","DevPro__enable_google_payments_buyflow","Concierge__enable_devsite_llm_tools","DevPro__enable_enterprise","Profiles__enable_playlist_community_acl","MiscFeatureFlags__enable_variable_operator","DevPro__enable_credits_banner","Profiles__enable_callout_notifications","Profiles__require_profile_eligibility_for_signin","DevPro__enable_vertex_credit_card","DevPro__enable_nvidia_credits_card","Profiles__enable_completequiz_endpoint","Profiles__enable_developer_profile_benefits_ui_redesign","DevPro__enable_free_benefits","Profiles__enable_complete_playlist_endpoint","Profiles__enable_public_developer_profiles","Profiles__enable_auto_apply_credits","Search__enable_ai_eligibility_checks","DevPro__enable_cloud_innovators_plus","Cloud__cache_serialized_dynamic_content","TpcFeatures__proxy_prod_host","MiscFeatureFlags__fix_lower_breadcrumbs","Search__enable_ai_search_summaries_for_all","Profiles__enable_page_saving","Profiles__enable_developer_profiles_callout","Profiles__enable_release_notes_notifications","Concierge__enable_remove_info_panel_tags","Profiles__enable_join_program_group_endpoint","MiscFeatureFlags__developers_footer_image","SignIn__enable_l1_signup_flow","Cloud__enable_cloud_shell","Cloud__enable_cloud_dlp_service","MiscFeatureFlags__enable_project_variables","Cloud__enable_cloud_shell_fte_user_flow","DevPro__enable_devpro_offers","DevPro__enable_google_payments","MiscFeatureFlags__remove_cross_domain_tracking_params","DevPro__remove_eu_tax_intake_form","Concierge__enable_pushui","DevPro__enable_code_assist","OnSwitch__enable","Profiles__enable_developer_profile_pages_as_content","DevPro__enable_firebase_workspaces_card","DevPro__enable_embed_profile_creation","TpcFeatures__enable_unmirrored_page_left_nav","MiscFeatureFlags__enable_view_transitions","DevPro__enable_developer_subscriptions","Experiments__reqs_query_experiments","Profiles__enable_targeted_hero","Concierge__enable_actions_menu","Analytics__enable_clearcut_logging","Profiles__enable_awarding_url"],null,null,"AIzaSyA58TaKli1DculwmAmbpzLVGuWc8eCQgQc","https://developerscontentserving-pa.googleapis.com","AIzaSyDWBU60w0P9hEkr29kkksYs8Z7gvZ8u_wc","https://developerscontentsearch-pa.googleapis.com",2,4,null,"https://developerprofiles-pa.googleapis.com",[59,"googledevai","Google AI for Developers","ai.google.dev",null,"googledevai-dot-devsite-v2-prod-3p.appspot.com",null,null,[null,1,null,null,null,null,null,null,null,null,null,[1],null,null,null,null,null,null,[1],null,null,null,null,[1],[1,1,null,1,1],null,null,null,null,null,[1]],null,[73,null,null,null,null,null,"/images/lockup-new.svg","/images/touchicon-180-new.png",null,null,null,null,1,1,null,null,null,null,null,null,null,2,null,null,null,"/images/lockup-dark-theme-new.svg",[]],[],null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,[44,2,4,6,7,12,14,15,17,18,20,21,22,23,28,29,32,37,39,40,43],null,[[],[1,1],null,1],[[null,null,null,null,null,["GTM-TC2MQKS8"],null,null,null,null,null,[["GTM-TC2MQKS8",1]],1]],null,4,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,[]],null,null,1,1,"https://developerscontentinsights-pa.googleapis.com","AIzaSyC11xEGtFhkmSh_iF6l_itbxnFz2GrIBOg","AIzaSyAXJ10nRF73mmdSDINgkCNX5bbd2KPcWm8","https://developers.googleapis.com",["https://aistudio.google.com"],null,"AIzaSyCjP0KOnHfv8mwe38sfzZJMOnqE3HvrD4A",null,null,"https://developers.googleapis.com"]')
</script>
<devsite-a11y-announce></devsite-a11y-announce>
</body>
</html>
Reference in New Issue View Git Blame Copy Permalink