chaiml-gem4-creative-dp_92255

developer_uid: rirv938
submission_id: chaiml-gem4-creative-dp_92255_v1
model_name: chaiml-gem4-creative-dp_92255_v1
model_group: ChaiML/gem4_creative_dpo
status: deployed
timestamp: 2026-04-17T00:53:45+00:00
num_battles: 7631
num_wins: 3876
celo_rating: 0.0
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/gem4_creative_dpo_2e5_beta4_cp312_merged
model_architecture: Gemma4ForConditionalGeneration
model_num_parameters: 28830461184.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-gem4-creative-dp_92255_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/gem4_creative_dpo_2e5_beta4_cp312_merged
model_size: 29B
ranking_group: single
us_pacific_date: 2026-04-16
win_ratio: 0.5079281876556152
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 64, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', 'You:', '<|im_start|>', '###', '<|turn>', '<turn|>', '<|redacted_im_end|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': '<bos><|turn>system\nRespond as a high quality storyteller<turn|>\n<|turn>user\n', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<turn|>\n<|turn>model\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gem4-creative-dp-92255-v1-uploader
Waiting for job on chaiml-gem4-creative-dp-92255-v1-uploader to finish
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
HTTP Request: %s %s "%s %d %s"
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gem4-creative-dp-59760-v1-uploader
Waiting for job on chaiml-gem4-creative-dp-59760-v1-uploader to finish
chaiml-gem4-creative-dp-92255-v1-uploader: Using quantization_mode: none
chaiml-gem4-creative-dp-92255-v1-uploader: Downloading snapshot of ChaiML/gem4_creative_dpo_2e5_beta4_cp312_merged...
chaiml-gem4-creative-dp-59760-v1-uploader: Using quantization_mode: none
chaiml-gem4-creative-dp-59760-v1-uploader: Downloading snapshot of ChaiML/gem4_creative_dpo_1e4_beta4_cp312_merged...
2026-04-17T00:44:59.629421+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
2026-04-17T00:45:04.424445+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
chaiml-gem4-creative-dp-59760-v1-uploader: Downloaded in 84.404s
chaiml-gem4-creative-dp-59760-v1-uploader: Processed model ChaiML/gem4_creative_dpo_1e4_beta4_cp312_merged in 84.539s
chaiml-gem4-creative-dp-59760-v1-uploader: creating bucket guanaco-vllm-models
chaiml-gem4-creative-dp-59760-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-59760-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-gem4-creative-dp-59760-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-gem4-creative-dp-59760-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-gem4-creative-dp-59760-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-59760-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-gem4-creative-dp-59760-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-59760-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-gem4-creative-dp-59760-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-59760-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-gem4-creative-dp-59760-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-59760-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-gem4-creative-dp-59760-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-gem4-creative-dp-59760-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-gem4-creative-dp-59760-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-gem4-creative-dp-59760-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-gem4-creative-dp-59760-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gem4-creative-dp-59760-v1-uploader: uploading /tmp/model_output to s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/tokenizer_config.json
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/model.safetensors.index.json
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/README.md s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/README.md
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/generation_config.json
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/.gitattributes
chaiml-gem4-creative-dp-92255-v1-uploader: Downloaded in 94.458s
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/config.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/config.json
chaiml-gem4-creative-dp-92255-v1-uploader: Processed model ChaiML/gem4_creative_dpo_2e5_beta4_cp312_merged in 94.602s
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/tokenizer.json
chaiml-gem4-creative-dp-92255-v1-uploader: creating bucket guanaco-vllm-models
chaiml-gem4-creative-dp-92255-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-92255-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-gem4-creative-dp-92255-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-gem4-creative-dp-92255-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-gem4-creative-dp-92255-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-92255-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-gem4-creative-dp-92255-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-92255-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-gem4-creative-dp-92255-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-92255-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-gem4-creative-dp-92255-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-gem4-creative-dp-92255-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-gem4-creative-dp-92255-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-gem4-creative-dp-92255-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-gem4-creative-dp-92255-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-gem4-creative-dp-92255-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-gem4-creative-dp-92255-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gem4-creative-dp-92255-v1-uploader: uploading /tmp/model_output to s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default
2026-04-17T00:45:59.941272+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/config.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/config.json
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/README.md s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/README.md
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/generation_config.json
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/tokenizer_config.json
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/.gitattributes
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/model.safetensors.index.json
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/tokenizer.json
2026-04-17T00:46:04.713097+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/model-00003-of-00003.safetensors s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/model-00003-of-00003.safetensors
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/model-00003-of-00003.safetensors s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/model-00003-of-00003.safetensors
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/model-00002-of-00003.safetensors s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/model-00002-of-00003.safetensors
chaiml-gem4-creative-dp-59760-v1-uploader: cp /tmp/model_output/model-00001-of-00003.safetensors s3://guanaco-vllm-models/chaiml-gem4-creative-dp-59760-v1/default/model-00001-of-00003.safetensors
2026-04-17T00:47:00.267887+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
2026-04-17T00:47:05.032429+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
Job chaiml-gem4-creative-dp-59760-v1-uploader completed after 183.69s with status: succeeded
Stopping job with name chaiml-gem4-creative-dp-59760-v1-uploader
Pipeline stage VLLMUploader completed in 185.43s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.46s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.37s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-gem4-creative-dp-59760-v1
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/model-00001-of-00003.safetensors s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/model-00001-of-00003.safetensors
chaiml-gem4-creative-dp-92255-v1-uploader: cp /tmp/model_output/model-00002-of-00003.safetensors s3://guanaco-vllm-models/chaiml-gem4-creative-dp-92255-v1/default/model-00002-of-00003.safetensors
Waiting for inference service chaiml-gem4-creative-dp-59760-v1 to be ready
Job chaiml-gem4-creative-dp-92255-v1-uploader completed after 204.59s with status: succeeded
Stopping job with name chaiml-gem4-creative-dp-92255-v1-uploader
Pipeline stage VLLMUploader completed in 206.15s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.43s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.12s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-gem4-creative-dp-92255-v1
Waiting for inference service chaiml-gem4-creative-dp-92255-v1 to be ready
2026-04-17T00:48:00.601955+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
2026-04-17T00:48:05.416646+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
2026-04-17T00:49:01.305878+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
2026-04-17T00:49:05.767176+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
2026-04-17T00:50:01.697634+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
2026-04-17T00:50:06.317260+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
2026-04-17T00:51:02.104528+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
2026-04-17T00:51:06.722451+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
Inference service chaiml-gem4-creative-dp-59760-v1 ready after 234.67249512672424s
Pipeline stage VLLMDeployer completed in 236.58s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 11.43072509765625s
Inference service chaiml-gem4-creative-dp-92255-v1 ready after 235.794597864151s
Pipeline stage VLLMDeployer completed in 237.58s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 11.192063093185425s
Received healthy response to inference request in 10.855968475341797s
Received healthy response to inference request in 2.729020357131958s
Received healthy response to inference request in 10.066277027130127s
Received healthy response to inference request in 2.7606375217437744s
Received healthy response to inference request in 2.7523562908172607s
Received healthy response to inference request in 9.71318244934082s
Received healthy response to inference request in 2.918494462966919s
Received healthy response to inference request in 2.921687364578247s
Received healthy response to inference request in 2.700841188430786s
Received healthy response to inference request in 4.355729818344116s
Received healthy response to inference request in 2.810136556625366s
Received healthy response to inference request in 4.529355525970459s
2026-04-17T00:52:02.629946+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
Received healthy response to inference request in 2.790670394897461s
Received healthy response to inference request in 2.6613924503326416s
2026-04-17T00:52:07.117647+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
Received healthy response to inference request in 2.784996271133423s
Received healthy response to inference request in 2.596115827560425s
Received healthy response to inference request in 2.9107625484466553s
Received healthy response to inference request in 2.743460178375244s
Received healthy response to inference request in 3.0132296085357666s
Received healthy response to inference request in 10.666010618209839s
Received healthy response to inference request in 10.842376947402954s
Received healthy response to inference request in 3.023052215576172s
Received healthy response to inference request in 11.91775631904602s
Received healthy response to inference request in 2.7545082569122314s
Received healthy response to inference request in 2.6892478466033936s
Received healthy response to inference request in 2.7375941276550293s
Received healthy response to inference request in 3.088575601577759s
Received healthy response to inference request in 3.0265679359436035s
Received healthy response to inference request in 3.132417678833008s
Received healthy response to inference request in 2.728703498840332s
Received healthy response to inference request in 9.766419649124146s
Received healthy response to inference request in 2.7794172763824463s
Received healthy response to inference request in 4.086678981781006s
Received healthy response to inference request in 2.7051315307617188s
Received healthy response to inference request in 2.8366572856903076s
Received healthy response to inference request in 2.783505916595459s
Received healthy response to inference request in 2.884608745574951s
Received healthy response to inference request in 2.8352866172790527s
2026-04-17T00:53:03.057587+00:00 monitor updated for chaiml-gem4-creative-dp_92255_v1
Received healthy response to inference request in 3.546165704727173s
Received healthy response to inference request in 9.755069732666016s
2026-04-17T00:53:07.511178+00:00 monitor updated for chaiml-gem4-creative-dp_59760_v1
Received healthy response to inference request in 2.8146164417266846s
Received healthy response to inference request in 2.9831199645996094s
Received healthy response to inference request in 2.8555378913879395s
Received healthy response to inference request in 2.69245982170105s
Received healthy response to inference request in 2.8515729904174805s
Received healthy response to inference request in 3.4501097202301025s
Received healthy response to inference request in 3.2677981853485107s
Received healthy response to inference request in 2.708143949508667s
Received healthy response to inference request in 2.787947177886963s
Received healthy response to inference request in 2.7787721157073975s
Received healthy response to inference request in 2.9745583534240723s
Received healthy response to inference request in 2.712717056274414s
Received healthy response to inference request in 2.947831153869629s
30 requests
Received healthy response to inference request in 2.7137515544891357s
0 failed requests
5th percentile: 2.7533246755599974
10th percentile: 2.76002459526062
20th percentile: 2.7901257514953612
30th percentile: 2.8290855646133424
40th percentile: 2.853951930999756
50th percentile: 2.914628505706787
60th percentile: 2.99002685546875
70th percentile: 3.1423423767089838
Received healthy response to inference request in 2.7705812454223633s
80th percentile: 4.140489149093629
90th percentile: 10.143887019157411
95th percentile: 11.034704327583311
99th percentile: 11.361513116359712
mean time: 4.2897910356521605
Pipeline stage StressChecker completed in 143.02s
Shutdown handler de-registered
chaiml-gem4-creative-dp_59760_v1 status is now deployed due to DeploymentManager action
Received healthy response to inference request in 2.794419527053833s
Received healthy response to inference request in 3.355334997177124s
Received healthy response to inference request in 2.9869577884674072s
30 requests
0 failed requests
5th percentile: 2.67392737865448
10th percentile: 2.6921386241912844
20th percentile: 2.7075414657592773
30th percentile: 2.724217915534973
40th percentile: 2.75738639831543
50th percentile: 2.7814615964889526
60th percentile: 2.9462604045867917
70th percentile: 3.0583228588104245
80th percentile: 3.665958881378177
90th percentile: 9.846163821220399
95th percentile: 10.770487439632415
99th percentile: 11.609837844371796
mean time: 4.18584512869517
Pipeline stage StressChecker completed in 137.56s
Shutdown handler de-registered
chaiml-gem4-creative-dp_92255_v1 status is now deployed due to DeploymentManager action