developer_uid: chai_backend_admin
submission_id: chaiml-2a6f-69d4-linear_43777_v6
model_name: chaiml-2a6f-69d4-linear_43777_v6
model_group: ChaiML/2a6f-69d4-linear-
status: torndown
timestamp: 2026-03-08T18:21:31+00:00
num_battles: 1366
num_wins: 664
celo_rating: 9299.83
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/2a6f-69d4-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 7
max_input_tokens: 1280
max_output_tokens: 64
reward_model: default
display_name: chaiml-2a6f-69d4-linear_43777_v6
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/2a6f-69d4-linear-w01-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.486090775988287
generation_params: {'temperature': 0.9, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.45, 'frequency_penalty': 0.45, 'stopping_words': ['\n'], 'max_input_tokens': 1280, 'best_of': 7, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-2a6f-69d4-linear-43777-v6-uploader
Waiting for job on chaiml-2a6f-69d4-linear-43777-v6-uploader to finish
chaiml-2a6f-69d4-linear-43777-v6-uploader: Using quantization_mode: fp8
chaiml-2a6f-69d4-linear-43777-v6-uploader: Repo ChaiML/2a6f-69d4-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-2a6f-69d4-linear-43777-v6-uploader: Checking if ChaiML/2a6f-69d4-linear-w01-FP8 already exists in ChaiML
chaiml-2a6f-69d4-linear-43777-v6-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-2a6f-69d4-linear-43777-v6-uploader: Downloading snapshot of ChaiML/2a6f-69d4-linear-w01-FP8...
chaiml-2a6f-69d4-linear-43777-v6-uploader: Downloaded in 12.653s
chaiml-2a6f-69d4-linear-43777-v6-uploader: Processed model ChaiML/2a6f-69d4-linear-w01-FP8 in 16.125s
chaiml-2a6f-69d4-linear-43777-v6-uploader: creating bucket guanaco-vllm-models
chaiml-2a6f-69d4-linear-43777-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-43777-v6-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-2a6f-69d4-linear-43777-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-2a6f-69d4-linear-43777-v6-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-2a6f-69d4-linear-43777-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-43777-v6-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-2a6f-69d4-linear-43777-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-43777-v6-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-2a6f-69d4-linear-43777-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-43777-v6-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-2a6f-69d4-linear-43777-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-43777-v6-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-2a6f-69d4-linear-43777-v6-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-2a6f-69d4-linear-43777-v6-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-2a6f-69d4-linear-43777-v6-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-2a6f-69d4-linear-43777-v6-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-2a6f-69d4-linear-43777-v6-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-2a6f-69d4-linear-43777-v6-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/special_tokens_map.json
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/generation_config.json
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/tokenizer_config.json
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/model.safetensors.index.json
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/config.json
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/recipe.yaml
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/.gitattributes
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/chat_template.jinja
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/tokenizer.json
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/model-00006-of-00006.safetensors
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/model-00005-of-00006.safetensors
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/model-00002-of-00006.safetensors
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/model-00003-of-00006.safetensors
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/model-00004-of-00006.safetensors
chaiml-2a6f-69d4-linear-43777-v6-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-43777-v6/default/model-00001-of-00006.safetensors
Job chaiml-2a6f-69d4-linear-43777-v6-uploader completed after 73.14s with status: succeeded
Stopping job with name chaiml-2a6f-69d4-linear-43777-v6-uploader
Pipeline stage VLLMUploader completed in 74.34s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.78s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-2a6f-69d4-linear-43777-v6
Waiting for inference service chaiml-2a6f-69d4-linear-43777-v6 to be ready
Inference service chaiml-2a6f-69d4-linear-43777-v6 ready after 130.37872290611267s
Pipeline stage VLLMDeployer completed in 130.79s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7129294872283936s
Received healthy response to inference request in 2.7886786460876465s
Received healthy response to inference request in 3.137054920196533s
Received healthy response to inference request in 2.9605214595794678s
Received healthy response to inference request in 2.913172721862793s
Received healthy response to inference request in 3.1050615310668945s
Received healthy response to inference request in 2.7648088932037354s
Received healthy response to inference request in 3.084329128265381s
Received healthy response to inference request in 2.842360019683838s
Received healthy response to inference request in 2.8766682147979736s
Received healthy response to inference request in 2.6818931102752686s
Received healthy response to inference request in 3.283790349960327s
Received healthy response to inference request in 2.941075325012207s
Received healthy response to inference request in 2.760840892791748s
Received healthy response to inference request in 2.7004005908966064s
Received healthy response to inference request in 2.9253642559051514s
Received healthy response to inference request in 3.712345838546753s
Received healthy response to inference request in 2.8699169158935547s
Received healthy response to inference request in 2.9789164066314697s
Received healthy response to inference request in 2.9399654865264893s
Received healthy response to inference request in 3.1242780685424805s
Received healthy response to inference request in 3.0226290225982666s
Received healthy response to inference request in 2.748150587081909s
Received healthy response to inference request in 2.6783485412597656s
Received healthy response to inference request in 2.79494047164917s
Received healthy response to inference request in 3.115976095199585s
Received healthy response to inference request in 2.835615396499634s
Received healthy response to inference request in 2.96382999420166s
Received healthy response to inference request in 2.9682700634002686s
Received healthy response to inference request in 2.7695553302764893s
30 requests
0 failed requests
5th percentile: 2.6902214765548704
10th percentile: 2.711676597595215
20th percentile: 2.764015293121338
30th percentile: 2.793061923980713
40th percentile: 2.858894157409668
50th percentile: 2.919268488883972
60th percentile: 2.948853778839111
70th percentile: 2.9714639663696287
80th percentile: 3.0884756088256835
90th percentile: 3.1255557537078857
95th percentile: 3.2177594065666195
99th percentile: 3.58806474685669
mean time: 2.933389592170715
Pipeline stage StressChecker completed in 90.61s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-2a6f-69d4-linear_43777_v6 status is now deployed due to DeploymentManager action
chaiml-2a6f-69d4-linear_43777_v6 status is now inactive due to system request
chaiml-2a6f-69d4-linear_43777_v6 status is now torndown due to DeploymentManager action