developer_uid: rirv938
submission_id: chaiml-gemma4-bobo-crea_18425_v2
model_name: chaiml-gemma4-bobo-crea_18425_v2
model_group: ChaiML/gemma4_bobo_creat
status: inactive
timestamp: 2026-04-07T08:18:21+00:00
num_battles: 10611
num_wins: 5308
celo_rating: 1305.9
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/gemma4_bobo_creative_fixed_with_edits_format_2_lr2-step625-merged
model_architecture: Gemma4ForConditionalGeneration
model_num_parameters: 28830461184.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-gemma4-bobo-crea_18425_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/gemma4_bobo_creative_fixed_with_edits_format_2_lr2-step625-merged
model_size: 29B
ranking_group: single
us_pacific_date: 2026-04-07
win_ratio: 0.5002356045613043
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_start|>', 'You:', '<|turn>', '<|redacted_im_end|>', '</s>', '###', '<turn|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '<bos><|turn>system\nRespond as a high quality storyteller.<turn|>\n', 'prompt_template': '', 'bot_template': '<|turn>model\n{bot_name}: {message}<turn|>\n', 'user_template': '<|turn>user\n{message}<turn|>\n', 'response_template': '<|turn>model\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gemma4-bobo-crea-18425-v2-uploader
Waiting for job on chaiml-gemma4-bobo-crea-18425-v2-uploader to finish
google-gemma-4-31b-it-v11-uploader: Using quantization_mode: none
google-gemma-4-31b-it-v11-uploader: Downloading snapshot of google/gemma-4-31B-it...
chaiml-gemma4-bobo-crea-89342-v2-uploader: Using quantization_mode: none
chaiml-gemma4-bobo-crea-89342-v2-uploader: Downloading snapshot of ChaiML/gemma4_bobo_creative_fixed_with_edits_format_2-step625-merged...
chaiml-gemma4-bobo-crea-89342-v2-uploader: Downloaded in 26.011s
google-gemma-4-31b-it-v11-uploader: Downloaded in 32.364s
2026-04-07T04:35:05.172828+00:00 monitor updated for google-gemma-4-31b-it_v11
chaiml-gemma4-bobo-crea-18425-v2-uploader: Using quantization_mode: none
2026-04-07T04:35:10.036049+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
chaiml-gemma4-bobo-crea-18425-v2-uploader: Downloading snapshot of ChaiML/gemma4_bobo_creative_fixed_with_edits_format_2_lr2-step625-merged...
google-gemma-4-31b-it-v11-uploader: Processed model google/gemma-4-31B-it in 54.841s
google-gemma-4-31b-it-v11-uploader: creating bucket guanaco-vllm-models
google-gemma-4-31b-it-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v11-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
google-gemma-4-31b-it-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
google-gemma-4-31b-it-v11-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
google-gemma-4-31b-it-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v11-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
google-gemma-4-31b-it-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v11-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
google-gemma-4-31b-it-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v11-uploader:   if re.search("-\.", bucket, re.UNICODE):
google-gemma-4-31b-it-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v11-uploader:   if re.search("\.\.", bucket, re.UNICODE):
google-gemma-4-31b-it-v11-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
2026-04-07T04:35:15.169923+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
google-gemma-4-31b-it-v11-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
google-gemma-4-31b-it-v11-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
google-gemma-4-31b-it-v11-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
google-gemma-4-31b-it-v11-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gemma4-bobo-crea-89342-v2-uploader: Processed model ChaiML/gemma4_bobo_creative_fixed_with_edits_format_2-step625-merged in 49.216s
google-gemma-4-31b-it-v11-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default
chaiml-gemma4-bobo-crea-89342-v2-uploader: creating bucket guanaco-vllm-models
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/.gitattributes
chaiml-gemma4-bobo-crea-89342-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/chat_template.jinja
chaiml-gemma4-bobo-crea-89342-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/config.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/README.md
chaiml-gemma4-bobo-crea-89342-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/processor_config.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/processor_config.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/tokenizer_config.json
chaiml-gemma4-bobo-crea-89342-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/model.safetensors.index.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/generation_config.json
chaiml-gemma4-bobo-crea-89342-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/tokenizer.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-gemma4-bobo-crea-89342-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-gemma4-bobo-crea-89342-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-gemma4-bobo-crea-89342-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-gemma4-bobo-crea-89342-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-gemma4-bobo-crea-89342-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-gemma4-bobo-crea-89342-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-gemma4-bobo-crea-89342-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-gemma4-bobo-crea-89342-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gemma4-bobo-crea-89342-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/chat_template.jinja
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/README.md
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/model.safetensors.index.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/args.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/processor_config.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/processor_config.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/config.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/tokenizer_config.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/generation_config.json
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/.gitattributes
chaiml-gemma4-bobo-crea-89342-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-89342-v2/default/tokenizer.json
Job chaiml-gemma4-bobo-crea-89342-v2-uploader completed after 87.5s with status: succeeded
Stopping job with name chaiml-gemma4-bobo-crea-89342-v2-uploader
Pipeline stage VLLMUploader completed in 89.55s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.71s
run pipeline stage %s
Running pipeline stage VLLMTemplater
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/model-00002-of-00002.safetensors s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/model-00002-of-00002.safetensors
Pipeline stage VLLMTemplater completed in 1.76s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-gemma4-bobo-crea-89342-v2
Waiting for inference service chaiml-gemma4-bobo-crea-89342-v2 to be ready
chaiml-gemma4-bobo-crea-18425-v2-uploader: Downloaded in 48.425s
2026-04-07T04:36:05.549593+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:36:10.622448+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
chaiml-gemma4-bobo-crea-18425-v2-uploader: Processed model ChaiML/gemma4_bobo_creative_fixed_with_edits_format_2_lr2-step625-merged in 73.752s
2026-04-07T04:36:15.636734+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
chaiml-gemma4-bobo-crea-18425-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gemma4-bobo-crea-18425-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/generation_config.json
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/config.json
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/.gitattributes
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/README.md
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/chat_template.jinja
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/processor_config.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/processor_config.json
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/tokenizer_config.json
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/args.json
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model.safetensors.index.json
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/tokenizer.json
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00002-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00002-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00007-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00007-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00003-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00003-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00004-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00004-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00006-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00006-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00005-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00005-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00009-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00009-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00001-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00001-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00012-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00012-of-00013.safetensors
chaiml-gemma4-bobo-crea-18425-v2-uploader: cp /dev/shm/model_output/model-00010-of-00013.safetensors s3://guanaco-vllm-models/chaiml-gemma4-bobo-crea-18425-v2/default/model-00010-of-00013.safetensors
google-gemma-4-31b-it-v11-uploader: cp /dev/shm/model_output/model-00001-of-00002.safetensors s3://guanaco-vllm-models/google-gemma-4-31b-it-v11/default/model-00001-of-00002.safetensors
Job google-gemma-4-31b-it-v11-uploader completed after 159.79s with status: succeeded
Stopping job with name google-gemma-4-31b-it-v11-uploader
Pipeline stage VLLMUploader completed in 161.68s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.75s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.36s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service google-gemma-4-31b-it-v11
Waiting for inference service google-gemma-4-31b-it-v11 to be ready
Job chaiml-gemma4-bobo-crea-18425-v2-uploader completed after 156.2s with status: succeeded
Stopping job with name chaiml-gemma4-bobo-crea-18425-v2-uploader
Pipeline stage VLLMUploader completed in 158.48s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.78s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.25s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-gemma4-bobo-crea-18425-v2
Waiting for inference service chaiml-gemma4-bobo-crea-18425-v2 to be ready
2026-04-07T04:37:06.009847+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:37:11.080283+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:37:16.130120+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:38:06.534112+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:38:11.602009+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:38:16.651778+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:39:07.064352+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:39:12.138786+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:39:17.159714+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:40:07.583373+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:40:12.649765+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:40:17.669649+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:41:08.108591+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:41:13.194322+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:41:18.210648+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:42:08.634021+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:42:13.730046+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:42:18.727812+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:43:09.133657+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:43:14.253734+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:43:19.265600+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:44:09.637845+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:44:14.759020+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:44:19.768313+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:45:10.126720+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:45:15.293985+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:45:20.325325+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:46:10.655834+00:00 monitor updated for google-gemma-4-31b-it_v11
Inference service chaiml-gemma4-bobo-crea-89342-v2 ready after 627.7318639755249s
Pipeline stage VLLMDeployer completed in 629.95s
run pipeline stage %s
Running pipeline stage StressChecker
2026-04-07T04:46:15.818448+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
2026-04-07T04:46:20.898384+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
Received healthy response to inference request in 7.22906756401062s
Received healthy response to inference request in 3.1426830291748047s
Received healthy response to inference request in 2.8681399822235107s
Received healthy response to inference request in 2.9525887966156006s
Received healthy response to inference request in 2.906381607055664s
Received healthy response to inference request in 2.9293041229248047s
Received healthy response to inference request in 2.6925296783447266s
Received healthy response to inference request in 2.864623785018921s
Received healthy response to inference request in 2.6891679763793945s
Received healthy response to inference request in 2.7902915477752686s
Received healthy response to inference request in 2.7953343391418457s
Received healthy response to inference request in 2.9331653118133545s
Received healthy response to inference request in 3.082709550857544s
Received healthy response to inference request in 2.690455675125122s
Received healthy response to inference request in 2.963911533355713s
2026-04-07T04:47:11.163197+00:00 monitor updated for google-gemma-4-31b-it_v11
Received healthy response to inference request in 3.339860439300537s
2026-04-07T04:47:16.487526+00:00 monitor updated for chaiml-gemma4-bobo-crea_89342_v2
Received healthy response to inference request in 2.8242452144622803s
Received healthy response to inference request in 2.721848726272583s
2026-04-07T04:47:21.618951+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
Received healthy response to inference request in 2.846531867980957s
Received healthy response to inference request in 2.9347760677337646s
Received healthy response to inference request in 2.862778425216675s
Received healthy response to inference request in 2.7271480560302734s
Received healthy response to inference request in 2.6969010829925537s
Received healthy response to inference request in 2.9604897499084473s
Received healthy response to inference request in 3.501776695251465s
Received healthy response to inference request in 2.6969776153564453s
Received healthy response to inference request in 2.9517767429351807s
Received healthy response to inference request in 2.8372867107391357s
Received healthy response to inference request in 2.8814620971679688s
Received healthy response to inference request in 2.8274075984954834s
30 requests
0 failed requests
5th percentile: 2.6913889765739443
10th percentile: 2.696463942527771
20th percentile: 2.7260881900787353
30th percentile: 2.8155719518661497
40th percentile: 2.8428338050842283
50th percentile: 2.866381883621216
60th percentile: 2.9155506134033202
70th percentile: 2.939876270294189
80th percentile: 2.9611741065979005
90th percentile: 3.162400770187378
95th percentile: 3.428914380073547
99th percentile: 6.1481532120704685
mean time: 3.0380540529886884
Pipeline stage StressChecker completed in 112.94s
Shutdown handler de-registered
chaiml-gemma4-bobo-crea_89342_v2 status is now deployed due to DeploymentManager action
2026-04-07T04:48:11.705637+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:48:22.174665+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:49:12.119982+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:49:22.598044+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:50:12.530579+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:50:22.987102+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:51:12.952964+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:51:23.390063+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:52:13.378521+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:52:23.757227+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
2026-04-07T04:53:13.793810+00:00 monitor updated for google-gemma-4-31b-it_v11
2026-04-07T04:53:24.167169+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
Inference service google-gemma-4-31b-it-v11 ready after 1032.5495669841766s
Pipeline stage VLLMDeployer completed in 1035.02s
run pipeline stage %s
Running pipeline stage StressChecker
Inference service chaiml-gemma4-bobo-crea-18425-v2 ready after 1031.8497948646545s
Pipeline stage VLLMDeployer completed in 1034.49s
run pipeline stage %s
Running pipeline stage StressChecker
2026-04-07T04:54:14.224136+00:00 monitor updated for google-gemma-4-31b-it_v11
Received healthy response to inference request in 7.23740816116333s
Received healthy response to inference request in 2.8844001293182373s
Received healthy response to inference request in 6.446270942687988s
Received healthy response to inference request in 2.7476606369018555s
Received healthy response to inference request in 2.733900308609009s
2026-04-07T04:54:24.562945+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
Received healthy response to inference request in 3.019719123840332s
Received healthy response to inference request in 3.14916729927063s
Received healthy response to inference request in 2.7036638259887695s
Received healthy response to inference request in 2.78326678276062s
Received healthy response to inference request in 2.828183174133301s
Received healthy response to inference request in 2.7320821285247803s
Received healthy response to inference request in 3.4029862880706787s
Received healthy response to inference request in 3.2627041339874268s
Received healthy response to inference request in 3.1903531551361084s
Received healthy response to inference request in 2.7051191329956055s
Received healthy response to inference request in 2.7877070903778076s
Received healthy response to inference request in 2.7177629470825195s
Received healthy response to inference request in 3.821565628051758s
Received healthy response to inference request in 2.792391300201416s
Received healthy response to inference request in 2.79744815826416s
Received healthy response to inference request in 2.842749834060669s
Received healthy response to inference request in 2.765477180480957s
Received healthy response to inference request in 2.805800676345825s
Received healthy response to inference request in 2.803896188735962s
Received healthy response to inference request in 3.0494906902313232s
Received healthy response to inference request in 3.1853890419006348s
Received healthy response to inference request in 2.7465991973876953s
Received healthy response to inference request in 2.962491750717163s
Received healthy response to inference request in 2.784132480621338s
Received healthy response to inference request in 2.781296968460083s
Received healthy response to inference request in 2.9351868629455566s
Received healthy response to inference request in 2.852858066558838s
Received healthy response to inference request in 2.7089035511016846s
Received healthy response to inference request in 2.7386720180511475s
Received healthy response to inference request in 2.807004690170288s
2026-04-07T04:55:14.828334+00:00 monitor updated for google-gemma-4-31b-it_v11
Received healthy response to inference request in 2.857879638671875s
Received healthy response to inference request in 2.849853038787842s
Received healthy response to inference request in 2.719667911529541s
Received healthy response to inference request in 2.806044816970825s
Received healthy response to inference request in 3.2663965225219727s
Received healthy response to inference request in 2.719013214111328s
2026-04-07T04:55:25.034127+00:00 monitor updated for chaiml-gemma4-bobo-crea_18425_v2
Received healthy response to inference request in 2.853654146194458s
Received healthy response to inference request in 2.712264060974121s
Received healthy response to inference request in 2.7878377437591553s
Received healthy response to inference request in 2.857757091522217s
Received healthy response to inference request in 2.686838388442993s
Received healthy response to inference request in 2.786381483078003s
Received healthy response to inference request in 2.8551948070526123s
Received healthy response to inference request in 2.9215779304504395s
Received healthy response to inference request in 2.692328691482544s
Received healthy response to inference request in 2.838347911834717s
Received healthy response to inference request in 2.9999945163726807s
Received healthy response to inference request in 2.716480255126953s
Received healthy response to inference request in 2.6919872760772705s
Received healthy response to inference request in 2.714933395385742s
Received healthy response to inference request in 2.7748823165893555s
Received healthy response to inference request in 2.715233325958252s
Received healthy response to inference request in 3.050227165222168s
Received healthy response to inference request in 2.916273593902588s
30 requests
0 failed requests
5th percentile: 2.6921409130096436
10th percentile: 2.702530312538147
20th percentile: 2.745862913131714
30th percentile: 2.7793725728988647
40th percentile: 2.7936039924621583
50th percentile: 2.8405206203460693
60th percentile: 2.8562687397003175
Received healthy response to inference request in 2.7452781200408936s
70th percentile: 2.9737425804138184
30 requests
80th percentile: 3.0772595405578618
0 failed requests
90th percentile: 3.2800554990768434
5th percentile: 2.710415780544281
95th percentile: 3.633204925060271
10th percentile: 2.71466646194458
99th percentile: 6.246813826560977
20th percentile: 2.7175064086914062
mean time: 3.0582688570022585
30th percentile: 2.73335485458374
Pipeline stage StressChecker completed in 120.13s
40th percentile: 2.76859974861145
Shutdown handler de-registered
50th percentile: 2.7893863916397095
google-gemma-4-31b-it_v11 status is now deployed due to DeploymentManager action
60th percentile: 2.8064287662506104
70th percentile: 2.844880795478821
80th percentile: 2.917334461212158
90th percentile: 3.059458351135254
95th percentile: 3.211612558364868
99th percentile: 5.523036568164828
mean time: 2.9433990399042766
Pipeline stage StressChecker completed in 116.26s
Shutdown handler de-registered
chaiml-gemma4-bobo-crea_18425_v2 status is now deployed due to DeploymentManager action
chaiml-gemma4-bobo-crea_18425_v2 status is now inactive due to auto deactivation removed underperforming models