developer_uid: chai_backend_admin
submission_id: chaiml-02f4-69d4-linear-w01_v57
model_name: chaiml-02f4-69d4-linear-w01_v57
model_group: ChaiML/02f4-69d4-linear-
status: torndown
timestamp: 2026-02-10T18:21:41+00:00
num_battles: 10818
num_wins: 5580
celo_rating: 1317.7
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/02f4-69d4-linear-w01
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-02f4-69d4-linear-w01_v57
is_internal_developer: True
language_model: ChaiML/02f4-69d4-linear-w01
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-07
win_ratio: 0.5158069883527454
generation_params: {'temperature': 0.7, 'top_p': 0.95, 'min_p': 0.025, 'top_k': 80, 'presence_penalty': 0.4, 'frequency_penalty': 0.4, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-02f4-69d4-linear-w01-v57-uploader
Waiting for job on chaiml-02f4-69d4-linear-w01-v57-uploader to finish
chaiml-02f4-69d4-linear-w01-v57-uploader: Using quantization_mode: none
chaiml-02f4-69d4-linear-w01-v57-uploader: Downloading snapshot of ChaiML/02f4-69d4-linear-w01...
chaiml-02f4-69d4-linear-w01-v57-uploader: 
Fetching 19 files:   0%|          | 0/19 [00:00<?, ?it/s]
Fetching 19 files:   5%|▌         | 1/19 [00:00<00:05,  3.45it/s]
Fetching 19 files:  32%|███▏      | 6/19 [00:16<00:37,  2.91s/it]
Fetching 19 files:  74%|███████▎  | 14/19 [00:19<00:06,  1.22s/it]
Fetching 19 files: 100%|██████████| 19/19 [00:19<00:00,  1.03s/it]
chaiml-02f4-69d4-linear-w01-v57-uploader: Downloaded in 19.774s
chaiml-02f4-69d4-linear-w01-v57-uploader: Processed model ChaiML/02f4-69d4-linear-w01 in 37.008s
chaiml-02f4-69d4-linear-w01-v57-uploader: creating bucket guanaco-vllm-models
chaiml-02f4-69d4-linear-w01-v57-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-w01-v57-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-02f4-69d4-linear-w01-v57-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-02f4-69d4-linear-w01-v57-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-02f4-69d4-linear-w01-v57-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-w01-v57-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-02f4-69d4-linear-w01-v57-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-w01-v57-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-02f4-69d4-linear-w01-v57-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-w01-v57-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-02f4-69d4-linear-w01-v57-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-w01-v57-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-02f4-69d4-linear-w01-v57-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-02f4-69d4-linear-w01-v57-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-02f4-69d4-linear-w01-v57-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-02f4-69d4-linear-w01-v57-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-02f4-69d4-linear-w01-v57-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-02f4-69d4-linear-w01-v57-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/README.md
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/mergekit_config.yaml s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/mergekit_config.yaml
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/.gitattributes
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/config.json
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/mergekit_config.yml s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/mergekit_config.yml
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model.safetensors.index.json
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/special_tokens_map.json
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/tokenizer_config.json
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/tokenizer.json
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00010-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00010-of-00010.safetensors
HTTP Request: %s %s "%s %d %s"
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00003-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00003-of-00010.safetensors
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00006-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00006-of-00010.safetensors
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00008-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00008-of-00010.safetensors
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00004-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00004-of-00010.safetensors
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00001-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00001-of-00010.safetensors
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00002-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00002-of-00010.safetensors
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00007-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00007-of-00010.safetensors
chaiml-02f4-69d4-linear-w01-v57-uploader: cp /dev/shm/model_output/model-00009-of-00010.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-w01-v57/model-00009-of-00010.safetensors
Job chaiml-02f4-69d4-linear-w01-v57-uploader completed after 258.96s with status: succeeded
Stopping job with name chaiml-02f4-69d4-linear-w01-v57-uploader
Pipeline stage VLLMUploader completed in 259.53s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.68s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-02f4-69d4-linear-w01-v57
Waiting for inference service chaiml-02f4-69d4-linear-w01-v57 to be ready
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-02f4-69d4-linear-w01-v57 ready after 221.3117413520813s
Pipeline stage VLLMDeployer completed in 223.54s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.167222023010254s
Received healthy response to inference request in 3.9816501140594482s
Received healthy response to inference request in 2.7703003883361816s
Received healthy response to inference request in 2.5546061992645264s
Received healthy response to inference request in 3.0470077991485596s
Received healthy response to inference request in 3.560788154602051s
Received healthy response to inference request in 3.1425163745880127s
Received healthy response to inference request in 3.272836446762085s
Received healthy response to inference request in 2.763763904571533s
Received healthy response to inference request in 2.6963460445404053s
Received healthy response to inference request in 3.000253915786743s
Received healthy response to inference request in 3.1072757244110107s
Received healthy response to inference request in 2.9187629222869873s
Received healthy response to inference request in 2.193812131881714s
Received healthy response to inference request in 2.4231691360473633s
Received healthy response to inference request in 2.2330405712127686s
Received healthy response to inference request in 2.3350372314453125s
Received healthy response to inference request in 2.39556622505188s
Received healthy response to inference request in 7.47574782371521s
Received healthy response to inference request in 2.2937238216400146s
Received healthy response to inference request in 2.4970903396606445s
Received healthy response to inference request in 2.2202584743499756s
Received healthy response to inference request in 2.4361348152160645s
Received healthy response to inference request in 2.643906831741333s
Received healthy response to inference request in 2.9266486167907715s
Received healthy response to inference request in 2.200293779373169s
Received healthy response to inference request in 2.2863430976867676s
Received healthy response to inference request in 2.5240821838378906s
Received healthy response to inference request in 2.396900177001953s
Received healthy response to inference request in 2.386596202850342s
30 requests
0 failed requests
5th percentile: 2.209277892112732
10th percentile: 2.2317623615264894
20th percentile: 2.326774549484253
30th percentile: 2.396499991416931
40th percentile: 2.4727081298828124
50th percentile: 2.5992565155029297
60th percentile: 2.7663784980773927
70th percentile: 2.9487302064895626
80th percentile: 3.114323854446411
90th percentile: 3.301631617546082
95th percentile: 3.792262232303618
99th percentile: 6.4624594879150425
mean time: 2.861722715695699
Pipeline stage StressChecker completed in 107.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
chaiml-02f4-69d4-linear-w01_v57 status is now deployed due to DeploymentManager action
chaiml-02f4-69d4-linear-w01_v57 status is now inactive due to auto deactivation removed underperforming models
chaiml-02f4-69d4-linear-w01_v57 status is now torndown due to DeploymentManager action