developer_uid: Meliodia
submission_id: chaiml-ca18-c13f-linea_65808_v15
model_name: chaiml-ca18-c13f-linear_65808_v5
model_group: ChaiML/ca18-c13f-linear-
status: torndown
timestamp: 2026-03-27T23:52:13+00:00
num_battles: 12416
num_wins: 5941
celo_rating: 8477.39
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/ca18-c13f-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 16
max_input_tokens: 1920
max_output_tokens: 60
reward_model: default
display_name: chaiml-ca18-c13f-linear_65808_v5
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/ca18-c13f-linear-w01-FP8
model_size: 13B
ranking_group: single
us_pacific_date: 2026-03-24
win_ratio: 0.47849548969072164
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.15, 'frequency_penalty': 0.15, 'stopping_words': ['\n', '###', 'You:', '</s>'], 'max_input_tokens': 1920, 'best_of': 16, 'max_output_tokens': 60}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Received healthy response to inference request in 6.7891621589660645s
Starting job with name chaiml-ca18-c13f-linea-65808-v15-uploader
Waiting for job on chaiml-ca18-c13f-linea-65808-v15-uploader to finish
Received healthy response to inference request in 6.687978506088257s
Received healthy response to inference request in 1.6805343627929688s
Received healthy response to inference request in 1.6832871437072754s
Received healthy response to inference request in 2.0921335220336914s
Received healthy response to inference request in 6.877558469772339s
Received healthy response to inference request in 6.689295768737793s
2026-03-24T22:19:55.507087+00:00 monitor updated for chaiml-ca18-c13f-linea_65808_v13
Received healthy response to inference request in 1.7398872375488281s
Received healthy response to inference request in 6.826912879943848s
Received healthy response to inference request in 1.6679656505584717s
Received healthy response to inference request in 1.6692829132080078s
Received healthy response to inference request in 2.015584707260132s
Received healthy response to inference request in 1.7354371547698975s
Received healthy response to inference request in 1.6668446063995361s
Received healthy response to inference request in 1.6695609092712402s
Received healthy response to inference request in 1.8819935321807861s
2026-03-24T22:20:18.081030+00:00 monitor updated for chaiml-ca18-c13f-linea_65808_v14
Received healthy response to inference request in 1.9306230545043945s
chaiml-ca18-c13f-linea-65808-v15-uploader: Using quantization_mode: fp8
Received healthy response to inference request in 1.6504061222076416s
Received healthy response to inference request in 1.7413370609283447s
Received healthy response to inference request in 1.7758409976959229s
Received healthy response to inference request in 1.699789047241211s
2026-03-24T22:20:27.483857+00:00 monitor updated for chaiml-ca18-c13f-linea_65808_v15
Received healthy response to inference request in 1.8164491653442383s
chaiml-ca18-c13f-linea-65808-v15-uploader: Repo ChaiML/ca18-c13f-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-ca18-c13f-linea-65808-v15-uploader: Checking if ChaiML/ca18-c13f-linear-w01-FP8 already exists in ChaiML
chaiml-ca18-c13f-linea-65808-v15-uploader: Model already exists. Downloading to /dev/shm/model_output...
Received healthy response to inference request in 1.8130121231079102s
chaiml-ca18-c13f-linea-65808-v15-uploader: Downloading snapshot of ChaiML/ca18-c13f-linear-w01-FP8...
chaiml-ca18-c13f-linea-65808-v15-uploader: Downloaded in 6.403s
chaiml-ca18-c13f-linea-65808-v15-uploader: Processed model ChaiML/ca18-c13f-linear-w01-FP8 in 9.835s
chaiml-ca18-c13f-linea-65808-v15-uploader: creating bucket guanaco-vllm-models
chaiml-ca18-c13f-linea-65808-v15-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linea-65808-v15-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-ca18-c13f-linea-65808-v15-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-ca18-c13f-linea-65808-v15-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-ca18-c13f-linea-65808-v15-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linea-65808-v15-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-ca18-c13f-linea-65808-v15-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
Received healthy response to inference request in 1.7033820152282715s
chaiml-ca18-c13f-linea-65808-v15-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-ca18-c13f-linea-65808-v15-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linea-65808-v15-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-ca18-c13f-linea-65808-v15-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linea-65808-v15-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-ca18-c13f-linea-65808-v15-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-ca18-c13f-linea-65808-v15-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-ca18-c13f-linea-65808-v15-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-ca18-c13f-linea-65808-v15-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-ca18-c13f-linea-65808-v15-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-ca18-c13f-linea-65808-v15-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default
Received healthy response to inference request in 1.6764934062957764s
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/README.md
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/recipe.yaml
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/tokenizer_config.json
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/generation_config.json
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/model.safetensors.index.json
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/special_tokens_map.json
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/chat_template.jinja
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/config.json
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/.gitattributes
chaiml-ca18-c13f-linea-65808-v15-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linea-65808-v15/default/tokenizer.json
Received healthy response to inference request in 1.898702621459961s
Received healthy response to inference request in 1.6687097549438477s
Received healthy response to inference request in 1.6910984516143799s
Received healthy response to inference request in 1.6694676876068115s
Received healthy response to inference request in 1.7335939407348633s
30 requests
0 failed requests
5th percentile: 1.6673490762710572
10th percentile: 1.6686353445053101
20th percentile: 1.6695422649383544
30th percentile: 1.6824613094329834
40th percentile: 1.7019448280334473
50th percentile: 1.7376621961593628
60th percentile: 1.7907094478607177
70th percentile: 1.8870062589645384
80th percentile: 2.030894470214844
90th percentile: 6.69928240776062
95th percentile: 6.809925055503845
Job chaiml-ca18-c13f-linea-65808-v15-uploader completed after 77.12s with status: succeeded
99th percentile: 6.862871248722077
Stopping job with name chaiml-ca18-c13f-linea-65808-v15-uploader
mean time: 2.594744165738424
Pipeline stage VLLMUploader completed in 78.49s
Pipeline stage StressChecker completed in 85.38s
run pipeline stage %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage VLLMTemplater completed in 0.55s
run pipeline stage %s
Running pipeline stage VLLMDeployer
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.26s
Creating inference service chaiml-ca18-c13f-linea-65808-v15
Shutdown handler de-registered
chaiml-ca18-c13f-linea_65808_v13 status is now deployed due to DeploymentManager action
Waiting for inference service chaiml-ca18-c13f-linea-65808-v15 to be ready
Inference service chaiml-ca18-c13f-linea-65808-v14 ready after 160.66505312919617s
Pipeline stage VLLMDeployer completed in 161.43s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.5604588985443115s
Received healthy response to inference request in 1.5686163902282715s
Received healthy response to inference request in 1.485443353652954s
2026-03-24T22:21:18.260794+00:00 monitor updated for chaiml-ca18-c13f-linea_65808_v14
Received healthy response to inference request in 1.584296464920044s
Received healthy response to inference request in 1.6558921337127686s
Received healthy response to inference request in 1.530024766921997s
Received healthy response to inference request in 1.646308183670044s
Received healthy response to inference request in 1.4826138019561768s
2026-03-24T22:21:27.669993+00:00 monitor updated for chaiml-ca18-c13f-linea_65808_v15
Received healthy response to inference request in 1.5979804992675781s
Received healthy response to inference request in 1.5286695957183838s
Received healthy response to inference request in 1.4866957664489746s
Received healthy response to inference request in 1.6424531936645508s
Received healthy response to inference request in 1.7744662761688232s
Received healthy response to inference request in 1.5829973220825195s
Received healthy response to inference request in 1.5820844173431396s
Received healthy response to inference request in 1.4853248596191406s
Received healthy response to inference request in 1.6609716415405273s
Received healthy response to inference request in 1.550004482269287s
Received healthy response to inference request in 1.6534709930419922s
Received healthy response to inference request in 1.4615116119384766s
Received healthy response to inference request in 1.4862534999847412s
Received healthy response to inference request in 1.497666597366333s
Received healthy response to inference request in 1.6091291904449463s
Received healthy response to inference request in 1.4809234142303467s
Received healthy response to inference request in 1.5644185543060303s
Received healthy response to inference request in 1.4830281734466553s
Received healthy response to inference request in 1.5979187488555908s
Received healthy response to inference request in 1.5657172203063965s
Received healthy response to inference request in 1.4891889095306396s
Received healthy response to inference request in 1.5585923194885254s
30 requests
0 failed requests
5th percentile: 1.4816840887069702
10th percentile: 1.4829867362976075
20th percentile: 1.4860914707183839
30th percentile: 1.495123291015625
40th percentile: 1.5420125961303712
50th percentile: 1.562438726425171
60th percentile: 1.5740036010742187
70th percentile: 1.588383150100708
80th percentile: 1.6157939910888672
90th percentile: 1.6537131071090698
95th percentile: 1.6586858630180359
99th percentile: 1.7415528321266176
mean time: 1.5617707093556723
Pipeline stage StressChecker completed in 53.13s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.00s
Shutdown handler de-registered
chaiml-ca18-c13f-linea_65808_v14 status is now deployed due to DeploymentManager action
2026-03-24T22:22:27.853691+00:00 monitor updated for chaiml-ca18-c13f-linea_65808_v15
2026-03-24T22:23:27.967561+00:00 monitor updated for chaiml-ca18-c13f-linea_65808_v15
Retrying (%r) after connection broken by '%r': %s
Inference service chaiml-ca18-c13f-linea-65808-v15 ready after 160.65763115882874s
Pipeline stage VLLMDeployer completed in 161.77s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 7.0194172859191895s
Received healthy response to inference request in 7.104338884353638s
Received healthy response to inference request in 6.760404348373413s
Received healthy response to inference request in 1.643918514251709s
Received healthy response to inference request in 6.739005088806152s
Received healthy response to inference request in 1.6777846813201904s
Received healthy response to inference request in 1.6975436210632324s
Received healthy response to inference request in 1.7205650806427002s
Received healthy response to inference request in 1.6696860790252686s
Received healthy response to inference request in 6.826474666595459s
Received healthy response to inference request in 1.6834697723388672s
Received healthy response to inference request in 1.8319847583770752s
Received healthy response to inference request in 1.662534475326538s
Received healthy response to inference request in 1.6861622333526611s
Received healthy response to inference request in 2.09037709236145s
Received healthy response to inference request in 1.767726182937622s
Received healthy response to inference request in 1.7341246604919434s
2026-03-24T22:24:28.078977+00:00 monitor updated for chaiml-ca18-c13f-linea_65808_v15
Received healthy response to inference request in 1.8539834022521973s
Received healthy response to inference request in 1.7593555450439453s
Received healthy response to inference request in 1.7333171367645264s
Received healthy response to inference request in 1.9402375221252441s
Received healthy response to inference request in 1.8785746097564697s
Received healthy response to inference request in 1.677635908126831s
Received healthy response to inference request in 1.6784965991973877s
Received healthy response to inference request in 1.6844165325164795s
Received healthy response to inference request in 1.7373476028442383s
Received healthy response to inference request in 1.765805959701538s
Received healthy response to inference request in 1.9768877029418945s
Received healthy response to inference request in 1.7271437644958496s
Received healthy response to inference request in 1.728363275527954s
30 requests
0 failed requests
5th percentile: 1.6657526969909668
10th percentile: 1.6768409252166747
20th percentile: 1.6824751377105713
30th percentile: 1.6941292047500611
40th percentile: 1.7278754711151123
50th percentile: 1.7357361316680908
60th percentile: 1.7665740489959716
70th percentile: 1.8613607645034789
80th percentile: 1.999585580825806
90th percentile: 6.767011380195618
95th percentile: 6.93259310722351
99th percentile: 7.079711620807648
mean time: 2.6152360995610553
Pipeline stage StressChecker completed in 81.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.72s
Shutdown handler de-registered
chaiml-ca18-c13f-linea_65808_v15 status is now deployed due to DeploymentManager action
chaiml-ca18-c13f-linea_65808_v15 status is now inactive due to auto deactivation removed underperforming models
chaiml-ca18-c13f-linea_65808_v15 status is now torndown due to DeploymentManager action