developer_uid: zonemercy
submission_id: chaiml-pony-v2-g46-lr1_80834_v24
model_name: chaiml-pony-v2-g46-lr1_80834_v24
model_group: ChaiML/pony-v2-g46-lr1e4
status: torndown
timestamp: 2026-03-08T03:53:08+00:00
num_battles: 12270
num_wins: 7059
celo_rating: 1342.82
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/pony-v2-g46-lr1e4ep1r64b16
model_architecture: Glm4MoeForCausalLM
model_num_parameters: 24110003200.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 80
reward_model: default
display_name: chaiml-pony-v2-g46-lr1_80834_v24
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/pony-v2-g46-lr1e4ep1r64b16
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-04
win_ratio: 0.5753056234718826
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 60, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|user|>', '<|im_end|>', '</s>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}
formatter: {'memory_template': "[gMASK]<sop><|system|>\n{bot_name}'s persona: {memory}.<|user|>\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '<|assistant|>\n<think></think>\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-pony-v2-g46-lr1-80834-v24-uploader
Waiting for job on chaiml-pony-v2-g46-lr1-80834-v24-uploader to finish
chaiml-pony-v2-g46-lr1-80834-v24-uploader: Checking if ChaiML/pony-v2-g46-lr1e4ep1r64b16-FP8 already exists in ChaiML
chaiml-pony-v2-g46-lr1-80834-v24-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-pony-v2-g46-lr1-80834-v24-uploader: Downloading snapshot of ChaiML/pony-v2-g46-lr1e4ep1r64b16-FP8...
chaiml-pony-v2-g46-lr1-80834-v24-uploader: Downloaded in 125.454s
chaiml-pony-v2-g46-lr1-80834-v24-uploader: Processed model ChaiML/pony-v2-g46-lr1e4ep1r64b16 in 128.876s
chaiml-pony-v2-g46-lr1-80834-v24-uploader: creating bucket guanaco-vllm-models
chaiml-pony-v2-g46-lr1-80834-v24-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-g46-lr1-80834-v24-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-pony-v2-g46-lr1-80834-v24-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-pony-v2-g46-lr1-80834-v24-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-pony-v2-g46-lr1-80834-v24-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-g46-lr1-80834-v24-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-pony-v2-g46-lr1-80834-v24-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-g46-lr1-80834-v24-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-pony-v2-g46-lr1-80834-v24-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-g46-lr1-80834-v24-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-pony-v2-g46-lr1-80834-v24-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-pony-v2-g46-lr1-80834-v24-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-pony-v2-g46-lr1-80834-v24-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-pony-v2-g46-lr1-80834-v24-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-pony-v2-g46-lr1-80834-v24-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-pony-v2-g46-lr1-80834-v24-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-pony-v2-g46-lr1-80834-v24-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-pony-v2-g46-lr1-80834-v24-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/generation_config.json
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/chat_template.jinja
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/.gitattributes
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/config.json
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/recipe.yaml
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model.safetensors.index.json
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/tokenizer.json
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00072-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00072-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00071-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00071-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00056-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00056-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00027-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00027-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00036-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00036-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00050-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00050-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00018-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00018-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00052-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00052-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00017-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00017-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00065-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00065-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00020-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00020-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00049-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00049-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00034-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00034-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00060-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00060-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00033-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00033-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00032-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00032-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00061-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00061-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00055-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00055-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00047-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00047-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00039-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00039-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00015-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00015-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00007-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00007-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00057-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00057-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00001-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00001-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00068-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00068-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00067-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00067-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00040-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00040-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00066-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00066-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00045-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00045-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00035-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00035-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00024-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00024-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00016-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00016-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00022-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00022-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00053-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00053-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00004-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00004-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00021-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00021-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00025-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00025-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00062-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00062-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00006-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00006-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00070-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00070-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00003-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00003-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00043-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00043-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00044-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00044-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00011-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00011-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00042-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00042-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00030-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00030-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00054-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00054-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00046-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00046-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00059-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00059-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00037-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00037-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00048-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00048-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00051-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00051-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00028-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00028-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00069-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00069-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00063-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00063-of-00072.safetensors
chaiml-pony-v2-g46-lr1-80834-v24-uploader: cp /dev/shm/model_output/model-00058-of-00072.safetensors s3://guanaco-vllm-models/chaiml-pony-v2-g46-lr1-80834-v24/default/model-00058-of-00072.safetensors
Job chaiml-pony-v2-g46-lr1-80834-v24-uploader completed after 278.54s with status: succeeded
Stopping job with name chaiml-pony-v2-g46-lr1-80834-v24-uploader
Pipeline stage VLLMUploader completed in 279.09s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.91s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-pony-v2-g46-lr1-80834-v24
Waiting for inference service chaiml-pony-v2-g46-lr1-80834-v24 to be ready
Inference service chaiml-pony-v2-g46-lr1-80834-v24 ready after 621.6628410816193s
Pipeline stage VLLMDeployer completed in 622.72s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5054075717926025s
Received healthy response to inference request in 2.1874871253967285s
Received healthy response to inference request in 2.1984269618988037s
Received healthy response to inference request in 2.1565558910369873s
Received healthy response to inference request in 2.6177706718444824s
Received healthy response to inference request in 2.2510080337524414s
Received healthy response to inference request in 2.3914783000946045s
Received healthy response to inference request in 2.066838264465332s
Received healthy response to inference request in 2.033153772354126s
Received healthy response to inference request in 2.2225043773651123s
Received healthy response to inference request in 2.531834363937378s
Received healthy response to inference request in 2.4325079917907715s
Received healthy response to inference request in 2.0879440307617188s
Received healthy response to inference request in 2.051042318344116s
Received healthy response to inference request in 2.142277956008911s
Received healthy response to inference request in 2.035482883453369s
Received healthy response to inference request in 2.0728890895843506s
Received healthy response to inference request in 2.4518485069274902s
Received healthy response to inference request in 2.0723989009857178s
Received healthy response to inference request in 2.1480507850646973s
Received healthy response to inference request in 2.2969565391540527s
Received healthy response to inference request in 2.569380283355713s
Received healthy response to inference request in 2.480041027069092s
Received healthy response to inference request in 2.034055709838867s
Received healthy response to inference request in 2.4343066215515137s
Received healthy response to inference request in 2.029829978942871s
Received healthy response to inference request in 2.3079004287719727s
Received healthy response to inference request in 2.00647234916687s
Received healthy response to inference request in 2.081683397293091s
Received healthy response to inference request in 2.0483815670013428s
30 requests
0 failed requests
5th percentile: 2.0313256859779356
10th percentile: 2.033965516090393
20th percentile: 2.0505101680755615
30th percentile: 2.0727420330047606
40th percentile: 2.1205443859100344
50th percentile: 2.172021508216858
60th percentile: 2.2339058399200438
70th percentile: 2.332973790168762
80th percentile: 2.4378149986267093
90th percentile: 2.50805025100708
95th percentile: 2.552484619617462
99th percentile: 2.603737459182739
mean time: 2.231530523300171
Pipeline stage StressChecker completed in 71.33s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.72s
Shutdown handler de-registered
chaiml-pony-v2-g46-lr1_80834_v24 status is now deployed due to DeploymentManager action
chaiml-pony-v2-g46-lr1_80834_v24 status is now inactive due to auto deactivation removed underperforming models
chaiml-pony-v2-g46-lr1_80834_v24 status is now torndown due to DeploymentManager action