developer_uid: chai_backend_admin
submission_id: chaiml-grpo-glm46-combi_79432_v2
model_name: chaiml-grpo-glm46-combi_79432_v2
model_group: ChaiML/grpo-glm46-combin
status: inactive
timestamp: 2026-03-13T01:23:10+00:00
num_battles: 16780
num_wins: 9361
celo_rating: 1335.06
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm46-combine-rm82-lr5e6-step150
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm46-combi_79432_v2
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm46-combine-rm82-lr5e6-step150
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-12
win_ratio: 0.5578665077473183
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '<|user|>', '</s>', '<|assistant|>', '####'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{bot_name}: {message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm46-combi-79432-v2-uploader
Waiting for job on chaiml-grpo-glm46-combi-79432-v2-uploader to finish
chaiml-grpo-glm46-combi-79432-v2-uploader: Using quantization_mode: fp8
chaiml-grpo-glm46-combi-79432-v2-uploader: Checking if ChaiML/grpo-glm46-combine-rm82-lr5e6-step150-FP8 already exists in ChaiML
chaiml-grpo-glm46-combi-79432-v2-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-grpo-glm46-combi-79432-v2-uploader: Downloading snapshot of ChaiML/grpo-glm46-combine-rm82-lr5e6-step150-FP8...
2026-03-12T17:37:10.541857+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:38:10.627557+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:39:10.769322+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
chaiml-grpo-glm46-combi-79432-v2-uploader: Downloaded in 152.293s
chaiml-grpo-glm46-combi-79432-v2-uploader: Processed model ChaiML/grpo-glm46-combine-rm82-lr5e6-step150 in 155.766s
chaiml-grpo-glm46-combi-79432-v2-uploader: creating bucket guanaco-vllm-models
chaiml-grpo-glm46-combi-79432-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v2-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-grpo-glm46-combi-79432-v2-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-grpo-glm46-combi-79432-v2-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-grpo-glm46-combi-79432-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v2-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-79432-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v2-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-grpo-glm46-combi-79432-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v2-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-79432-v2-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-grpo-glm46-combi-79432-v2-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-grpo-glm46-combi-79432-v2-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-grpo-glm46-combi-79432-v2-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-grpo-glm46-combi-79432-v2-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm46-combi-79432-v2-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm46-combi-79432-v2-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm46-combi-79432-v2-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/config.json
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/chat_template.jinja
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/generation_config.json
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/recipe.yaml
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/special_tokens_map.json
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/tokenizer_config.json
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/.gitattributes
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model.safetensors.index.json
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/tokenizer.json
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00072-of-00072.safetensors
2026-03-12T17:40:10.857327+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00071-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00020-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00069-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00070-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00001-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00064-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00009-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00053-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00005-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00063-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00033-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00021-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00002-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00029-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00031-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00023-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00043-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00057-of-00072.safetensors
chaiml-grpo-glm46-combi-79432-v2-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-combi-79432-v2/default/model-00061-of-00072.safetensors
2026-03-12T17:41:10.946421+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
Job chaiml-grpo-glm46-combi-79432-v2-uploader completed after 301.08s with status: succeeded
Stopping job with name chaiml-grpo-glm46-combi-79432-v2-uploader
Pipeline stage VLLMUploader completed in 301.58s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.08s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm46-combi-79432-v2
Waiting for inference service chaiml-grpo-glm46-combi-79432-v2 to be ready
2026-03-12T17:42:11.595371+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:43:11.711400+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:44:11.814391+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:45:11.922377+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:46:12.027433+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:47:12.125520+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:48:12.220132+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:49:12.313899+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:50:12.811596+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
2026-03-12T17:51:12.906214+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
Inference service chaiml-grpo-glm46-combi-79432-v2 ready after 611.5409350395203s
Pipeline stage VLLMDeployer completed in 612.05s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.08745551109314s
Received healthy response to inference request in 2.068359375s
Received healthy response to inference request in 2.0519988536834717s
Received healthy response to inference request in 2.071924924850464s
Received healthy response to inference request in 2.0823428630828857s
Received healthy response to inference request in 2.0942635536193848s
Received healthy response to inference request in 2.0186383724212646s
Received healthy response to inference request in 2.109128475189209s
Received healthy response to inference request in 2.2001442909240723s
Received healthy response to inference request in 2.0449061393737793s
Received healthy response to inference request in 1.976980447769165s
Received healthy response to inference request in 2.023221254348755s
Received healthy response to inference request in 2.139089822769165s
Received healthy response to inference request in 2.0525810718536377s
Received healthy response to inference request in 2.093541383743286s
Received healthy response to inference request in 2.0112640857696533s
Received healthy response to inference request in 2.356311559677124s
Received healthy response to inference request in 2.143718719482422s
2026-03-12T17:52:12.999316+00:00 monitor updated for chaiml-grpo-glm46-combi_79432_v2
Received healthy response to inference request in 2.0413105487823486s
Received healthy response to inference request in 2.082463264465332s
Received healthy response to inference request in 2.105112314224243s
Received healthy response to inference request in 2.208575487136841s
Received healthy response to inference request in 2.1349058151245117s
Received healthy response to inference request in 2.0502045154571533s
Received healthy response to inference request in 2.073367118835449s
Received healthy response to inference request in 2.0656075477600098s
Received healthy response to inference request in 2.038454055786133s
Received healthy response to inference request in 2.151665687561035s
Received healthy response to inference request in 2.150787830352783s
Received healthy response to inference request in 2.058999538421631s
30 requests
0 failed requests
5th percentile: 2.0145825147628784
10th percentile: 2.022762966156006
20th percentile: 2.0441870212554933
30th percentile: 2.052406406402588
40th percentile: 2.0672586441040037
50th percentile: 2.0778549909591675
60th percentile: 2.0938302516937255
70th percentile: 2.1168616771698
80th percentile: 2.145132541656494
90th percentile: 2.2009874105453493
95th percentile: 2.289830327033996
99th percentile: 7.135423765182501
mean time: 2.3262441476186115
Pipeline stage StressChecker completed in 72.72s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.83s
Shutdown handler de-registered
chaiml-grpo-glm46-combi_79432_v2 status is now deployed due to DeploymentManager action
chaiml-grpo-glm46-combi_79432_v2 status is now inactive due to system request