google-gemma-4-31b-it

developer_uid: rirv938

submission_id: google-gemma-4-31b-it_v15

model_name: google-gemma-4-31b-it_v15

model_group: google/gemma-4-31B-it

status: inactive

timestamp: 2026-04-07T19:38:24+00:00

num_battles: 7147

num_wins: 3415

celo_rating: 1289.37

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: basic

model_repo: google/gemma-4-31B-it

model_architecture: Gemma4ForConditionalGeneration

model_num_parameters: 28830461184.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 80

reward_model: default

display_name: google-gemma-4-31b-it_v15

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: google/gemma-4-31B-it

model_size: 29B

ranking_group: single

us_pacific_date: 2026-04-07

win_ratio: 0.477822862739611

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|turn>', '<|im_start|>', '<|redacted_im_end|>', '<turn|>', 'You:', '</s>', '###'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}

formatter: {'memory_template': '<bos><|turn>system\nYou are "{bot_name}". Stay in character and respond only as "{bot_name}". You are allowed to be NSFW in the response if relevant to the conversation. Create an entertaining dialogue.<turn|>\n', 'prompt_template': '', 'bot_template': '<|turn>model\n{bot_name}: {message}<turn|>\n', 'user_template': '<|turn>user\n{message}<turn|>\n', 'response_template': '<|turn>model\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name google-gemma-4-31b-it-v15-uploader
Waiting for job on google-gemma-4-31b-it-v15-uploader to finish
google-gemma-4-31b-it-v15-uploader: Using quantization_mode: none
google-gemma-4-31b-it-v15-uploader: Downloading snapshot of google/gemma-4-31B-it...
google-gemma-4-31b-it-v15-uploader: Downloaded in 33.150s
2026-04-07T17:11:57.057306+00:00 monitor updated for google-gemma-4-31b-it_v15
google-gemma-4-31b-it-v15-uploader: creating bucket guanaco-vllm-models
google-gemma-4-31b-it-v15-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v15-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
google-gemma-4-31b-it-v15-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
google-gemma-4-31b-it-v15-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
google-gemma-4-31b-it-v15-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v15-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
google-gemma-4-31b-it-v15-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v15-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
google-gemma-4-31b-it-v15-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v15-uploader:   if re.search("-\.", bucket, re.UNICODE):
google-gemma-4-31b-it-v15-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v15-uploader:   if re.search("\.\.", bucket, re.UNICODE):
google-gemma-4-31b-it-v15-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
google-gemma-4-31b-it-v15-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
google-gemma-4-31b-it-v15-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
google-gemma-4-31b-it-v15-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
google-gemma-4-31b-it-v15-uploader: Bucket 's3://guanaco-vllm-models/' created
google-gemma-4-31b-it-v15-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/.gitattributes
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/README.md
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/config.json
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/chat_template.jinja
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/generation_config.json
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/processor_config.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/processor_config.json
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/model.safetensors.index.json
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/tokenizer_config.json
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/tokenizer.json
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/model-00002-of-00002.safetensors s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/model-00002-of-00002.safetensors
2026-04-07T17:12:57.220875+00:00 monitor updated for google-gemma-4-31b-it_v15
google-gemma-4-31b-it-v15-uploader: cp /dev/shm/model_output/model-00001-of-00002.safetensors s3://guanaco-vllm-models/google-gemma-4-31b-it-v15/default/model-00001-of-00002.safetensors
Job google-gemma-4-31b-it-v15-uploader completed after 168.76s with status: succeeded
Stopping job with name google-gemma-4-31b-it-v15-uploader
Pipeline stage VLLMUploader completed in 169.87s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.18s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.03s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service google-gemma-4-31b-it-v15
Waiting for inference service google-gemma-4-31b-it-v15 to be ready
2026-04-07T17:13:57.418008+00:00 monitor updated for google-gemma-4-31b-it_v15
2026-04-07T17:14:57.590290+00:00 monitor updated for google-gemma-4-31b-it_v15
2026-04-07T17:15:57.772261+00:00 monitor updated for google-gemma-4-31b-it_v15
2026-04-07T17:16:57.950164+00:00 monitor updated for google-gemma-4-31b-it_v15
Inference service google-gemma-4-31b-it-v15 ready after 212.42399883270264s
Pipeline stage VLLMDeployer completed in 213.43s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.79676365852356s
Received healthy response to inference request in 2.9655020236968994s
Received healthy response to inference request in 2.532923698425293s
Received healthy response to inference request in 2.582942485809326s
Received healthy response to inference request in 2.514519453048706s
Received healthy response to inference request in 3.0416622161865234s
Received healthy response to inference request in 2.5548949241638184s
Received healthy response to inference request in 3.0949547290802s
Received healthy response to inference request in 2.778580665588379s
Received healthy response to inference request in 2.508972406387329s
Received healthy response to inference request in 2.636186361312866s
2026-04-07T17:17:58.119545+00:00 monitor updated for google-gemma-4-31b-it_v15
Received healthy response to inference request in 2.747756004333496s
Received healthy response to inference request in 2.6097676753997803s
Received healthy response to inference request in 2.5906145572662354s
Received healthy response to inference request in 2.773815631866455s
Received healthy response to inference request in 3.121828079223633s
Received healthy response to inference request in 2.6017165184020996s
Received healthy response to inference request in 2.6476457118988037s
Received healthy response to inference request in 2.527362823486328s
Received healthy response to inference request in 2.634390354156494s
Received healthy response to inference request in 2.7116291522979736s
Received healthy response to inference request in 2.8720524311065674s
Received healthy response to inference request in 2.715665340423584s
Received healthy response to inference request in 2.635226249694824s
Received healthy response to inference request in 2.89424729347229s
Received healthy response to inference request in 2.710228443145752s
Received healthy response to inference request in 2.7020785808563232s
Received healthy response to inference request in 2.6479110717773438s
Received healthy response to inference request in 2.6753861904144287s
Received healthy response to inference request in 2.604982852935791s
30 requests
0 failed requests
5th percentile: 2.520298969745636
10th percentile: 2.5323676109313964
20th percentile: 2.5890801429748533
30th percentile: 2.6083322286605837
40th percentile: 2.6358023166656492
50th percentile: 2.6616486310958862
60th percentile: 2.7107887268066406
70th percentile: 2.7555738925933837
80th percentile: 2.876491403579712
90th percentile: 3.046991467475891
95th percentile: 3.109735071659088
99th percentile: 5.731032340526584
mean time: 2.8477402528127036
Pipeline stage StressChecker completed in 90.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.09s
Shutdown handler de-registered
google-gemma-4-31b-it_v15 status is now deployed due to DeploymentManager action
google-gemma-4-31b-it_v15 status is now inactive due to admin request