docs: add canonical tooling corpus (147 files) from Google/HF/frameworks

Browse Source

Five-lane parallel research pass. Each subdir under tooling/ has its own
README indexing downloaded files with verified upstream sources.

- google-official/: deepmind-gemma JAX examples, gemma_pytorch scripts,
  gemma.cpp API server docs, google-gemma/cookbook notebooks, ai.google.dev
  HTML snapshots, Gemma 3 tech report
- huggingface/: 8 gemma-4-* model cards, chat-template .jinja files,
  tokenizer_config.json, transformers gemma4/ source, launch blog posts,
  official HF Spaces app.py
- inference-frameworks/: vLLM/llama.cpp/MLX/Keras-hub/TGI/Gemini API/Vertex AI
  comparison, run_commands.sh with 8 working launches, 9 code snippets
- gemma-family/: 12 per-variant briefs (ShieldGemma 2, CodeGemma, PaliGemma 2,
  Recurrent/Data/Med/TxGemma, Embedding/Translate/Function/Dolphin/SignGemma)
- fine-tuning/: Unsloth Gemma 4 notebooks, Axolotl YAMLs (incl 26B-A4B MoE),
  TRL scripts, Google cookbook fine-tune notebooks, recipe-recommendation.md

Findings that update earlier CORPUS_* docs are flagged in tooling/README.md
(not applied) — notably the new <|turn>/<turn|> prompt format, gemma_pytorch
abandonment, gemma.cpp Gemini-API server, transformers AutoModelForMultimodalLM,
FA2 head_dim=512 break, 26B-A4B MoE quantization rules, no Gemma 4 tech
report PDF yet, no Gemma-4-generation specialized siblings yet.

Pre-commit secrets hook bypassed per user authorization — flagged "secrets"
are base64 notebook cell outputs and example Ed25519 keys in the HDP
agentic-security demo, not real credentials.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

...

This commit is contained in:

Mortdecai

2026-04-18 12:24:48 -04:00

parent 5011059f5d

commit eecebe7ef5

149 changed files with 181297 additions and 0 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

tooling/fine-tuning/unsloth/notebooks/Gemma4_(26B_A4B)-Text.ipynb

+7723

File diff suppressed because it is too large Load Diff

tooling/fine-tuning/unsloth/notebooks/Gemma4_(26B_A4B)-Vision.ipynb

+6426

File diff suppressed because one or more lines are too long

tooling/fine-tuning/unsloth/notebooks/Gemma4_(31B)-Text.ipynb

+7707

File diff suppressed because it is too large Load Diff

tooling/fine-tuning/unsloth/notebooks/Gemma4_(31B)-Vision.ipynb

+6404

File diff suppressed because one or more lines are too long

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E2B)-Audio.ipynb

+5745

File diff suppressed because one or more lines are too long

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E2B)-Text.ipynb

+7119

File diff suppressed because one or more lines are too long

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E2B)-Vision.ipynb

+5673

File diff suppressed because one or more lines are too long

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E2B)_GRPO.ipynb

+5531

File diff suppressed because it is too large Load Diff

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E2B)_Reinforcement_Learning_2048_Game.ipynb

+11898

File diff suppressed because it is too large Load Diff

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E2B)_Reinforcement_Learning_Sudoku_Game.ipynb

+10738

File diff suppressed because it is too large Load Diff

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E4B)-Audio.ipynb

+5742

File diff suppressed because one or more lines are too long

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E4B)-Text.ipynb

+7100

File diff suppressed because one or more lines are too long

tooling/fine-tuning/unsloth/notebooks/Gemma4_(E4B)-Vision.ipynb

+5679

File diff suppressed because one or more lines are too long