chaiml-gspo-glm47-chai-r_6996

developer_uid: chai_backend_admin
submission_id: chaiml-gspo-glm47-chai-r_6996_v1
model_name: chaiml-gspo-glm47-chai-r_6996_v1
model_group: ChaiML/gspo-glm47-chai-r
status: torndown
timestamp: 2026-04-02T22:31:20+00:00
num_battles: 11581
num_wins: 6826
celo_rating: 1374.13
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/gspo-glm47-chai-rm-mega-data-step1000
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-gspo-glm47-chai-r_6996_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/gspo-glm47-chai-rm-mega-data-step1000
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-30
win_ratio: 0.5894136948450047
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '<|user|>', '<|assistant|>', '<|im_end|>', '</s>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>{message}', 'user_template': '<|user|>{message}', 'response_template': '<|assistant|></think>', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gspo-glm47-chai-r-6996-v1-uploader
Waiting for job on chaiml-gspo-glm47-chai-r-6996-v1-uploader to finish
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Using quantization_mode: w4a16
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Checking if ChaiML/gspo-glm47-chai-rm-mega-data-step1000-W4A16 already exists in ChaiML
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Downloading snapshot of ChaiML/gspo-glm47-chai-rm-mega-data-step1000...
2026-03-30T20:21:48.562736+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:22:48.867016+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:23:49.153665+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:24:49.429253+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:25:49.687006+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Downloaded in 264.921s
2026-03-30T20:26:49.773687+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:27:50.041097+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:28:50.309100+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
Retrying (%r) after connection broken by '%r': %s
2026-03-30T20:29:50.828766+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Applying quantization...
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:30:21 INFO __init__.py L202: Patched transformers.models.glm4_moe.modeling_glm4_moe.Glm4MoeMoE -> auto_round.modeling.unfused_moe.glm_moe.LinearGlm4MoeMoE[0m
2026-03-30T20:30:51.128692+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:30:53 INFO base.py L486: using torch.bfloat16 for quantization tuning[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:03 INFO device.py L1468:  'peak_ram': 12.04GB, 'peak_vram': 1.44GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:07 INFO device.py L1468:  'peak_ram': 16.55GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:15 INFO device.py L1468:  'peak_ram': 17.07GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:19 INFO device.py L1468:  'peak_ram': 19.48GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:27 INFO device.py L1468:  'peak_ram': 19.95GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:31 INFO device.py L1468:  'peak_ram': 22.37GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:35 INFO device.py L1468:  'peak_ram': 22.37GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:41 INFO device.py L1468:  'peak_ram': 22.83GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:45 INFO device.py L1468:  'peak_ram': 22.83GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:31:51.431819+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:52 INFO device.py L1468:  'peak_ram': 23.43GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:31:58 INFO device.py L1468:  'peak_ram': 23.43GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:32:02 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:32:08 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:32:12 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:32:16 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:32:27 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:32:38 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:32:51.518397+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:32:52 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:33:03 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:33:14 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:33:30 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:33:42 INFO device.py L1468:  'peak_ram': 23.63GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:33:51.609124+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:33:57 INFO device.py L1468:  'peak_ram': 24.11GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:34:10 INFO device.py L1468:  'peak_ram': 24.11GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:34:21 INFO device.py L1468:  'peak_ram': 24.62GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:34:38 INFO device.py L1468:  'peak_ram': 24.62GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:34:51.702913+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:34:49 INFO device.py L1468:  'peak_ram': 25.56GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:35:00 INFO device.py L1468:  'peak_ram': 25.56GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:35:14 INFO device.py L1468:  'peak_ram': 26.28GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:35:26 INFO device.py L1468:  'peak_ram': 26.28GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:35:39 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:35:51.825224+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:35:50 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:36:01 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:36:15 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:36:26 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:36:37 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:36:51.918347+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:36:51 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:37:02 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:37:18 INFO device.py L1468:  'peak_ram': 27.14GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:37:31 INFO device.py L1468:  'peak_ram': 27.85GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:37:43 INFO device.py L1468:  'peak_ram': 27.85GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:37:52.121970+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:38:02 INFO device.py L1468:  'peak_ram': 29.05GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:38:16 INFO device.py L1468:  'peak_ram': 29.05GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:38:35 INFO device.py L1468:  'peak_ram': 29.86GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:38:51 INFO device.py L1468:  'peak_ram': 29.86GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:38:52.453022+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:39:06 INFO device.py L1468:  'peak_ram': 30.3GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:39:22 INFO device.py L1468:  'peak_ram': 30.3GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:39:39 INFO device.py L1468:  'peak_ram': 31.29GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:39:53.698109+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:39:52 INFO device.py L1468:  'peak_ram': 31.29GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:40:07 INFO device.py L1468:  'peak_ram': 32.09GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:40:20 INFO device.py L1468:  'peak_ram': 32.09GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:40:38 INFO device.py L1468:  'peak_ram': 32.09GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:40:53.909665+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:40:54 INFO device.py L1468:  'peak_ram': 32.09GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:41:07 INFO device.py L1468:  'peak_ram': 32.09GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:41:24 INFO device.py L1468:  'peak_ram': 32.09GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:41:40 INFO device.py L1468:  'peak_ram': 32.09GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:41:54.003964+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:41:59 INFO device.py L1468:  'peak_ram': 32.86GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:42:14 INFO device.py L1468:  'peak_ram': 32.86GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:42:25 INFO device.py L1468:  'peak_ram': 33.29GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:42:42 INFO device.py L1468:  'peak_ram': 33.29GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:42:50 INFO device.py L1468:  'peak_ram': 34.05GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:42:54.279683+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:42:56 INFO device.py L1468:  'peak_ram': 34.05GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:43:07 INFO device.py L1468:  'peak_ram': 34.88GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:43:22 INFO device.py L1468:  'peak_ram': 34.88GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:43:41 INFO device.py L1468:  'peak_ram': 36.16GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:43:54.496333+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:43:55 INFO device.py L1468:  'peak_ram': 36.16GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:44:09 INFO device.py L1468:  'peak_ram': 36.74GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:44:26 INFO device.py L1468:  'peak_ram': 36.74GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:44:41 INFO device.py L1468:  'peak_ram': 37.55GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:44:55.007102+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:44:58 INFO device.py L1468:  'peak_ram': 37.55GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:45:04 INFO device.py L1468:  'peak_ram': 37.55GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:45:09 INFO device.py L1468:  'peak_ram': 37.55GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:45:30 INFO device.py L1468:  'peak_ram': 37.69GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:45:42 INFO device.py L1468:  'peak_ram': 37.69GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:45:55.293483+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:45:58 INFO device.py L1468:  'peak_ram': 38.87GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:46:10 INFO device.py L1468:  'peak_ram': 38.87GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:46:23 INFO device.py L1468:  'peak_ram': 39.83GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:46:33 INFO device.py L1468:  'peak_ram': 39.83GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:46:44 INFO device.py L1468:  'peak_ram': 40.41GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:46:55.591690+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:46:57 INFO device.py L1468:  'peak_ram': 40.41GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:47:07 INFO device.py L1468:  'peak_ram': 41.5GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:47:16 INFO device.py L1468:  'peak_ram': 41.5GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:47:28 INFO device.py L1468:  'peak_ram': 42.45GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:47:37 INFO device.py L1468:  'peak_ram': 42.45GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:47:47 INFO device.py L1468:  'peak_ram': 43.63GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:47:54 INFO device.py L1468:  'peak_ram': 43.63GB, 'peak_vram': 1.59GB[0m
2026-03-30T20:47:56.382836+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:48:00 INFO device.py L1468:  'peak_ram': 44.39GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:48:09 INFO device.py L1468:  'peak_ram': 44.39GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:48:15 INFO device.py L1468:  'peak_ram': 44.67GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:48:23 INFO device.py L1468:  'peak_ram': 44.67GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:48:28 INFO device.py L1468:  'peak_ram': 44.67GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:48:38 INFO shard_writer.py L208: model has been saved to /dev/shm/model_output/[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [33;1m2026-03-30 20:48:38 WARNING export.py L336: /dev/shm/model_output already exists, this may cause model conflict[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: [38;20m2026-03-30 20:48:38 INFO device.py L1468:  'peak_ram': 44.67GB, 'peak_vram': 1.59GB[0m
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Checking if ChaiML/gspo-glm47-chai-rm-mega-data-step1000-W4A16 already exists in ChaiML
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Creating repo ChaiML/gspo-glm47-chai-rm-mega-data-step1000-W4A16 and uploading /dev/shm/model_output to it
chaiml-gspo-glm47-chai-r-6996-v1-uploader: ---------- 2026-03-30 20:48:39 (0:00:00) ----------
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Files:   hashed 7/45 (32.0M/197.4G) | pre-uploaded: 0/1 (0.0/197.4G) (+42 unsure) | committed: 0/45 (0.0/197.4G) | ignored: 0
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Workers: hashing: 38 | get upload mode: 1 | pre-uploading: 1 | committing: 0 | waiting: 24
chaiml-gspo-glm47-chai-r-6996-v1-uploader: ---------------------------------------------------
2026-03-30T20:48:56.489976+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: 
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
chaiml-gspo-glm47-chai-r-6996-v1-uploader: ---------- 2026-03-30 20:49:39 (0:01:00) ----------
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Files:   hashed 45/45 (197.4G/197.4G) | pre-uploaded: 3/40 (1.6G/197.4G) | committed: 0/45 (0.0/197.4G) | ignored: 0
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 37 | committing: 0 | waiting: 27
chaiml-gspo-glm47-chai-r-6996-v1-uploader: ---------------------------------------------------
2026-03-30T20:49:56.778970+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader:                              
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
chaiml-gspo-glm47-chai-r-6996-v1-uploader: ---------- 2026-03-30 20:50:39 (0:02:00) ----------
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Files:   hashed 45/45 (197.4G/197.4G) | pre-uploaded: 21/40 (95.5G/197.4G) | committed: 0/45 (0.0/197.4G) | ignored: 0
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 19 | committing: 0 | waiting: 45
chaiml-gspo-glm47-chai-r-6996-v1-uploader: ---------------------------------------------------
2026-03-30T20:50:57.389333+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader:                              
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
[K[F
chaiml-gspo-glm47-chai-r-6996-v1-uploader: ---------- 2026-03-30 20:51:39 (0:03:00) ----------
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Files:   hashed 45/45 (197.4G/197.4G) | pre-uploaded: 40/40 (197.4G/197.4G) | committed: 0/45 (0.0/197.4G) | ignored: 0
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Workers: hashing: 0 | get upload mode: 0 | pre-uploading: 0 | committing: 1 | waiting: 63
chaiml-gspo-glm47-chai-r-6996-v1-uploader: ---------------------------------------------------
2026-03-30T20:51:58.439823+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader:                              Processed model ChaiML/gspo-glm47-chai-rm-mega-data-step1000 in 1836.001s
chaiml-gspo-glm47-chai-r-6996-v1-uploader: creating bucket guanaco-vllm-models
chaiml-gspo-glm47-chai-r-6996-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-chai-r-6996-v1-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-gspo-glm47-chai-r-6996-v1-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-gspo-glm47-chai-r-6996-v1-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-gspo-glm47-chai-r-6996-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-chai-r-6996-v1-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-gspo-glm47-chai-r-6996-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-chai-r-6996-v1-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-gspo-glm47-chai-r-6996-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-chai-r-6996-v1-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-gspo-glm47-chai-r-6996-v1-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-gspo-glm47-chai-r-6996-v1-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-gspo-glm47-chai-r-6996-v1-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-gspo-glm47-chai-r-6996-v1-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-gspo-glm47-chai-r-6996-v1-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-gspo-glm47-chai-r-6996-v1-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-gspo-glm47-chai-r-6996-v1-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-gspo-glm47-chai-r-6996-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/config.json
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/generation_config.json
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/chat_template.jinja
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/tokenizer_config.json
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/quantization_config.json s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/quantization_config.json
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model.safetensors.index.json
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/tokenizer.json
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00038-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00038-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00037-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00037-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00036-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00036-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00016-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00016-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00029-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00029-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00021-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00021-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00008-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00008-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00009-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00009-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00031-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00031-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00013-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00013-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00035-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00035-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00028-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00028-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00010-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00010-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00033-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00033-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00026-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00026-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00027-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00027-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00017-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00017-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00032-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00032-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00018-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00018-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00006-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00006-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00014-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00014-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00034-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00034-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00003-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00003-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00007-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00007-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00001-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00001-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00015-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00015-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00019-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00019-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00005-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00005-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00011-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00011-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00030-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00030-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00025-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00025-of-00038.safetensors
2026-03-30T20:52:58.553463+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00004-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00004-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00023-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00023-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00002-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00002-of-00038.safetensors
chaiml-gspo-glm47-chai-r-6996-v1-uploader: cp /dev/shm/model_output/model-00024-of-00038.safetensors s3://guanaco-vllm-models/chaiml-gspo-glm47-chai-r-6996-v1/default/model-00024-of-00038.safetensors
Job chaiml-gspo-glm47-chai-r-6996-v1-uploader completed after 1959.89s with status: succeeded
Stopping job with name chaiml-gspo-glm47-chai-r-6996-v1-uploader
Pipeline stage VLLMUploader completed in 1961.09s
run pipeline stage %s
Running pipeline stage VLLMUploaderAMD
Pipeline stage vllm_upload_amd skipped, reason=not amd cluster
Pipeline stage VLLMUploaderAMD completed in 0.16s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.55s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-gspo-glm47-chai-r-6996-v1
Waiting for inference service chaiml-gspo-glm47-chai-r-6996-v1 to be ready
2026-03-30T20:53:58.869221+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:54:59.171513+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
Failed to get request counts for guanaco-submitter. Falling back to default
2026-03-30T20:55:59.455859+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:56:59.640500+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:58:00.620105+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T20:59:01.068964+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T21:00:01.398371+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T21:01:01.753062+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T21:02:01.966343+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T21:03:03.428028+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
2026-03-30T21:04:03.741147+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
Inference service chaiml-gspo-glm47-chai-r-6996-v1 ready after 661.9835324287415s
Pipeline stage VLLMDeployer completed in 662.82s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 8.825662612915039s
Received healthy response to inference request in 2.098832130432129s
Received healthy response to inference request in 3.351888418197632s
Received healthy response to inference request in 2.756314277648926s
Received healthy response to inference request in 2.3253543376922607s
Received healthy response to inference request in 2.0469205379486084s
Received healthy response to inference request in 2.136749267578125s
2026-03-30T21:05:04.178362+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
Received healthy response to inference request in 2.009674072265625s
Received healthy response to inference request in 2.295952796936035s
Received healthy response to inference request in 2.77876615524292s
Received healthy response to inference request in 2.024289608001709s
Received healthy response to inference request in 2.1063730716705322s
Received healthy response to inference request in 2.057013511657715s
Received healthy response to inference request in 2.1939070224761963s
Received healthy response to inference request in 2.3837685585021973s
Received healthy response to inference request in 2.113206386566162s
Received healthy response to inference request in 2.1087684631347656s
Received healthy response to inference request in 2.759519100189209s
Received healthy response to inference request in 1.992384910583496s
Received healthy response to inference request in 1.9925801753997803s
Received healthy response to inference request in 2.650995969772339s
Received healthy response to inference request in 2.1160733699798584s
Received healthy response to inference request in 2.461918354034424s
Received healthy response to inference request in 1.966568946838379s
Received healthy response to inference request in 2.6016170978546143s
Received healthy response to inference request in 2.15655255317688s
Received healthy response to inference request in 2.100064516067505s
Received healthy response to inference request in 2.5870201587677s
Received healthy response to inference request in 2.0496768951416016s
Received healthy response to inference request in 2.1931965351104736s
30 requests
0 failed requests
5th percentile: 1.992472779750824
10th percentile: 2.0079646825790407
2026-03-30T21:06:04.985726+00:00 monitor updated for chaiml-gspo-glm47-chai-r_6996_v1
20th percentile: 2.049125623703003
30th percentile: 2.0996948003768923
40th percentile: 2.1114312171936036
50th percentile: 2.1466509103775024
60th percentile: 2.2347253322601315
70th percentile: 2.407213497161865
80th percentile: 2.611492872238159
90th percentile: 2.7614438056945803
95th percentile: 3.09398339986801
99th percentile: 7.238268096446996
mean time: 2.5080536603927612
Pipeline stage StressChecker completed in 90.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.81s
Shutdown handler de-registered
chaiml-gspo-glm47-chai-r_6996_v1 status is now deployed due to DeploymentManager action
chaiml-gspo-glm47-chai-r_6996_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-gspo-glm47-chai-r_6996_v1 status is now torndown due to DeploymentManager action