developer_uid: zonemercy
submission_id: chaiml-pony-d3-g46-pv2-_64172_v7
model_name: chaiml-pony-d3-g46-pv2-_64172_v7
model_group: ChaiML/pony-d3-g46-pv2-l
status: torndown
timestamp: 2026-03-12T16:21:42+00:00
num_battles: 14827
num_wins: 8476
celo_rating: 1350.84
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-d3-g46-pv2-_64172_v7
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-09
win_ratio: 0.5716598098064342
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}", 'prompt_template': '', 'bot_template': '<|assistant|>\n{message}', 'user_template': '<|user|>\n{message}', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-d3-g46-pv2-64172-v7-uploader
Waiting for job on chaiml-pony-d3-g46-pv2-64172-v7-uploader to finish
chaiml-pony-d3-g46-pv2-64172-v7-uploader: Using quantization_mode: fp8
chaiml-pony-d3-g46-pv2-64172-v7-uploader: Checking if ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8 already exists in ChaiML
chaiml-pony-d3-g46-pv2-64172-v7-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-d3-g46-pv2-64172-v7-uploader: Downloading snapshot of ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8-FP8...
chaiml-pony-d3-g46-pv2-64172-v7-uploader: Downloaded in 155.714s
chaiml-pony-d3-g46-pv2-64172-v7-uploader: Processed model ChaiML/pony-d3-g46-pv2-lr5e6ep2r64b8 in 159.278s
chaiml-pony-d3-g46-pv2-64172-v7-uploader: creating bucket guanaco-vllm-models
chaiml-pony-d3-g46-pv2-64172-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v7-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-d3-g46-pv2-64172-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-d3-g46-pv2-64172-v7-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-d3-g46-pv2-64172-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v7-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v7-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v7-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-d3-g46-pv2-64172-v7-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-d3-g46-pv2-64172-v7-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-d3-g46-pv2-64172-v7-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-d3-g46-pv2-64172-v7-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-d3-g46-pv2-64172-v7-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-d3-g46-pv2-64172-v7-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-d3-g46-pv2-64172-v7-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/chat_template.jinja
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/.gitattributes
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/config.json
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/generation_config.json
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/special_tokens_map.json
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/recipe.yaml
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/tokenizer_config.json
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model.safetensors.index.json
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00072-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00071-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00039-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00053-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00061-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00015-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00021-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00051-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00040-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00058-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00002-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00002-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00020-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00027-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00009-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00009-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00014-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00014-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00068-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00056-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00028-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00004-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00003-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00050-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00037-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00006-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00005-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00005-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00036-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00034-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00017-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00038-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00038-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00016-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00044-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00052-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00012-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00012-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00055-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00001-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00057-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00026-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00026-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00049-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00063-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00010-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00010-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00041-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00041-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00033-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00066-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00042-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00007-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00032-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00065-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00018-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00035-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00054-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00024-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00048-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00013-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00013-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00030-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00008-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00008-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00045-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00069-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00064-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00064-of-00072.safetensors
chaiml-pony-d3-g46-pv2-64172-v7-uploader: cp /dev/shm/model_output/model-00029-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-d3-g46-pv2-64172-v7/default/model-00029-of-00072.safetensors
Job chaiml-pony-d3-g46-pv2-64172-v7-uploader completed after 310.47s with status: succeeded
Stopping job with name chaiml-pony-d3-g46-pv2-64172-v7-uploader
Pipeline stage VLLMUploader completed in 310.99s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 4.25s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-d3-g46-pv2-64172-v7
Waiting for inference service chaiml-pony-d3-g46-pv2-64172-v7 to be ready
Inference service chaiml-pony-d3-g46-pv2-64172-v7 ready after 713.3376324176788s
Pipeline stage VLLMDeployer completed in 714.35s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1129519939422607s
Received healthy response to inference request in 2.09578013420105s
Received healthy response to inference request in 2.126380681991577s
Received healthy response to inference request in 2.0353803634643555s
Received healthy response to inference request in 2.04729962348938s
Received healthy response to inference request in 2.07322359085083s
Received healthy response to inference request in 2.1242315769195557s
Received healthy response to inference request in 2.033261299133301s
Received healthy response to inference request in 2.0516796112060547s
Received healthy response to inference request in 2.120605945587158s
Received healthy response to inference request in 2.167099952697754s
Received healthy response to inference request in 2.0872132778167725s
Received healthy response to inference request in 2.1255500316619873s
Received healthy response to inference request in 2.347475051879883s
Received healthy response to inference request in 2.1067397594451904s
Received healthy response to inference request in 2.1152544021606445s
Received healthy response to inference request in 2.0997231006622314s
Received healthy response to inference request in 2.083296537399292s
Received healthy response to inference request in 2.0593438148498535s
Received healthy response to inference request in 2.013643503189087s
Received healthy response to inference request in 2.0776543617248535s
Received healthy response to inference request in 2.1012563705444336s
Received healthy response to inference request in 2.1897084712982178s
Received healthy response to inference request in 2.309508800506592s
Received healthy response to inference request in 2.073763847351074s
Received healthy response to inference request in 2.1142826080322266s
Received healthy response to inference request in 2.0761892795562744s
Received healthy response to inference request in 2.1982688903808594s
Received healthy response to inference request in 2.170067310333252s
Received healthy response to inference request in 2.1877782344818115s
30 requests
0 failed requests
5th percentile: 2.0342148780822753
10th percentile: 2.0461076974868773
20th percentile: 2.070447635650635
30th percentile: 2.07721483707428
40th percentile: 2.0923533916473387
50th percentile: 2.103998064994812
60th percentile: 2.114671325683594
70th percentile: 2.124627113342285
80th percentile: 2.1676934242248533
90th percentile: 2.190564513206482
95th percentile: 2.259450840950012
99th percentile: 2.3364648389816285
mean time: 2.117487080891927
Pipeline stage StressChecker completed in 67.47s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.72s
Shutdown handler de-registered
chaiml-pony-d3-g46-pv2-_64172_v7 status is now deployed due to DeploymentManager action
chaiml-pony-d3-g46-pv2-_64172_v7 status is now inactive due to auto deactivation removed underperforming models
chaiml-pony-d3-g46-pv2-_64172_v8 status is now torndown due to DeploymentManager action