developer_uid: richhx
submission_id: chaiml-grpo-glm46-chai-_81744_v6
model_name: chaiml-grpo-glm46-chai-_81744_v6
model_group: ChaiML/grpo-glm46-chai-r
status: inactive
timestamp: 2026-03-19T07:36:41+00:00
num_battles: 10299
num_wins: 5808
celo_rating: 1339.53
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/grpo-glm46-chai-rm-lr5e6-step150
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 1500
max_output_tokens: 80
reward_model: default
display_name: chaiml-grpo-glm46-chai-_81744_v6
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/grpo-glm46-chai-rm-lr5e6-step150
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-19
win_ratio: 0.5639382464316924
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '<|user|>', '<|assistant|>', '</s>', '<|im_end|>'], 'max_input_tokens': 1500, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{bot_name}: {message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-grpo-glm46-chai-81744-v6-uploader
Waiting for job on chaiml-grpo-glm46-chai-81744-v6-uploader to finish
chaiml-grpo-glm46-chai-81744-v6-uploader: Using quantization_mode: fp8
chaiml-grpo-glm46-chai-81744-v6-uploader: Checking if ChaiML/grpo-glm46-chai-rm-lr5e6-step150-FP8 already exists in ChaiML
chaiml-grpo-glm46-chai-81744-v6-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-grpo-glm46-chai-81744-v6-uploader: Downloading snapshot of ChaiML/grpo-glm46-chai-rm-lr5e6-step150-FP8...
2026-03-19T03:13:11.277557+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
2026-03-19T03:14:11.425775+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
2026-03-19T03:15:11.510677+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
chaiml-grpo-glm46-chai-81744-v6-uploader: Downloaded in 156.083s
chaiml-grpo-glm46-chai-81744-v6-uploader: Processed model ChaiML/grpo-glm46-chai-rm-lr5e6-step150 in 159.568s
chaiml-grpo-glm46-chai-81744-v6-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-grpo-glm46-chai-81744-v6-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-grpo-glm46-chai-81744-v6-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-grpo-glm46-chai-81744-v6-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/.gitattributes
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/chat_template.jinja
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/generation_config.json
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/config.json
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/recipe.yaml
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/tokenizer_config.json
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model.safetensors.index.json
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/tokenizer.json
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/special_tokens_map.json
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00072-of-00072.safetensors
2026-03-19T03:16:11.600370+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00071-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00024-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00042-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00025-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00065-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00060-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00023-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00023-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00058-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00070-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00020-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00038-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00021-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00036-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00045-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00008-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00015-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00031-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00031-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00052-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00022-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00019-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00019-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00051-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00057-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00028-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00018-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00003-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00067-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00013-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00040-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00041-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00001-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00029-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00044-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00059-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00034-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00007-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00047-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00062-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00068-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00027-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00048-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00014-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00055-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00066-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00030-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00064-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00032-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00061-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00053-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00002-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00063-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00035-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00054-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00046-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00056-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00043-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00069-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00039-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00049-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00011-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00017-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00016-of-00072.safetensors
chaiml-grpo-glm46-chai-81744-v6-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-grpo-glm46-chai-81744-v6/default/model-00004-of-00072.safetensors
2026-03-19T03:17:11.696927+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
Job chaiml-grpo-glm46-chai-81744-v6-uploader completed after 306.62s with status: succeeded
Stopping job with name chaiml-grpo-glm46-chai-81744-v6-uploader
Pipeline stage VLLMUploader completed in 307.08s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 1.55s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-grpo-glm46-chai-81744-v6
Waiting for inference service chaiml-grpo-glm46-chai-81744-v6 to be ready
2026-03-19T03:18:11.794426+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
2026-03-19T03:19:11.894811+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
2026-03-19T03:20:11.988467+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
2026-03-19T03:21:12.085321+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
2026-03-19T03:22:12.181583+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
2026-03-19T03:23:12.279548+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
2026-03-19T03:24:12.379285+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
Inference service chaiml-grpo-glm46-chai-81744-v6 ready after 441.60670495033264s
Pipeline stage VLLMDeployer completed in 442.05s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 9.104487419128418s
Received healthy response to inference request in 2.1292073726654053s
Received healthy response to inference request in 2.2515056133270264s
Received healthy response to inference request in 2.2194323539733887s
Received healthy response to inference request in 2.0856356620788574s
Received healthy response to inference request in 9.261537075042725s
Received healthy response to inference request in 1.9887118339538574s
2026-03-19T03:25:12.478982+00:00 monitor updated for chaiml-grpo-glm46-chai-_81744_v6
Received healthy response to inference request in 2.0202648639678955s
Received healthy response to inference request in 2.01070237159729s
Received healthy response to inference request in 2.1954216957092285s
Received healthy response to inference request in 2.0938239097595215s
Received healthy response to inference request in 1.9998996257781982s
Received healthy response to inference request in 2.1406681537628174s
Received healthy response to inference request in 2.0090696811676025s
Received healthy response to inference request in 1.9812216758728027s
Received healthy response to inference request in 2.005903482437134s
Received healthy response to inference request in 2.024282455444336s
Received healthy response to inference request in 4.1544787883758545s
Received healthy response to inference request in 2.05964732170105s
Received healthy response to inference request in 2.0799925327301025s
Received healthy response to inference request in 2.1554574966430664s
Received healthy response to inference request in 1.9995882511138916s
Received healthy response to inference request in 1.992436170578003s
Received healthy response to inference request in 2.1192829608917236s
Received healthy response to inference request in 2.0528392791748047s
Received healthy response to inference request in 2.0931499004364014s
Received healthy response to inference request in 2.046863555908203s
Received healthy response to inference request in 2.0750982761383057s
Received healthy response to inference request in 2.055778741836548s
Received healthy response to inference request in 2.001194953918457s
30 requests
0 failed requests
5th percentile: 1.990387785434723
10th percentile: 1.9988730430603028
20th percentile: 2.0049617767333983
30th percentile: 2.017396116256714
40th percentile: 2.050448989868164
50th percentile: 2.0673727989196777
60th percentile: 2.088641357421875
70th percentile: 2.1222602844238283
80th percentile: 2.163450336456299
90th percentile: 2.441802930831912
95th percentile: 6.87698353528975
99th percentile: 9.215992674827575
mean time: 2.613586115837097
Pipeline stage StressChecker completed in 81.31s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-grpo-glm46-chai-_81744_v6 status is now deployed due to DeploymentManager action
chaiml-grpo-glm46-chai-_81744_v6 status is now inactive due to auto deactivation removed underperforming models