developer_uid: richhx
submission_id: chaiml-ca18-c13f-linear_65808_v8
model_name: chaiml-ca18-c13f-linear_65808_v8
model_group: ChaiML/ca18-c13f-linear-
status: inactive
timestamp: 2026-03-05T19:12:49+00:00
num_battles: 2873
num_wins: 1345
celo_rating: 1267.24
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/ca18-c13f-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 7
max_input_tokens: 1280
max_output_tokens: 60
reward_model: default
display_name: chaiml-ca18-c13f-linear_65808_v8
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/ca18-c13f-linear-w01-FP8
model_size: 13B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.46815175774451795
generation_params: {'temperature': 1.0, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 60, 'presence_penalty': 0.15, 'frequency_penalty': 0.15, 'stopping_words': ['\n', '</s>', 'You:', '###'], 'max_input_tokens': 1280, 'best_of': 7, 'max_output_tokens': 60}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-ca18-c13f-linear-65808-v8-uploader
Waiting for job on chaiml-ca18-c13f-linear-65808-v8-uploader to finish
chaiml-ca18-c13f-linear-65808-v8-uploader: Using quantization_mode: fp8
chaiml-ca18-c13f-linear-65808-v8-uploader: Repo ChaiML/ca18-c13f-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-ca18-c13f-linear-65808-v8-uploader: Checking if ChaiML/ca18-c13f-linear-w01-FP8 already exists in ChaiML
chaiml-ca18-c13f-linear-65808-v8-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-ca18-c13f-linear-65808-v8-uploader: Downloading snapshot of ChaiML/ca18-c13f-linear-w01-FP8...
chaiml-ca18-c13f-linear-65808-v8-uploader: Downloaded in 8.192s
chaiml-ca18-c13f-linear-65808-v8-uploader: Processed model ChaiML/ca18-c13f-linear-w01-FP8 in 11.761s
chaiml-ca18-c13f-linear-65808-v8-uploader: creating bucket guanaco-vllm-models
chaiml-ca18-c13f-linear-65808-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linear-65808-v8-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-ca18-c13f-linear-65808-v8-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-ca18-c13f-linear-65808-v8-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-ca18-c13f-linear-65808-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linear-65808-v8-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-ca18-c13f-linear-65808-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linear-65808-v8-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-ca18-c13f-linear-65808-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linear-65808-v8-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-ca18-c13f-linear-65808-v8-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-ca18-c13f-linear-65808-v8-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-ca18-c13f-linear-65808-v8-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-ca18-c13f-linear-65808-v8-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-ca18-c13f-linear-65808-v8-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-ca18-c13f-linear-65808-v8-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-ca18-c13f-linear-65808-v8-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-ca18-c13f-linear-65808-v8-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/chat_template.jinja
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/generation_config.json
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/config.json
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/.gitattributes
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/recipe.yaml
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/model.safetensors.index.json
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/tokenizer_config.json
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/special_tokens_map.json
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/tokenizer.json
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/model-00003-of-00003.safetensors s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/model-00003-of-00003.safetensors
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/model-00001-of-00003.safetensors s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/model-00001-of-00003.safetensors
chaiml-ca18-c13f-linear-65808-v8-uploader: cp /dev/shm/model_output/model-00002-of-00003.safetensors s3://guanaco-vllm-models/chaiml-ca18-c13f-linear-65808-v8/default/model-00002-of-00003.safetensors
Job chaiml-ca18-c13f-linear-65808-v8-uploader completed after 72.97s with status: succeeded
Stopping job with name chaiml-ca18-c13f-linear-65808-v8-uploader
Pipeline stage VLLMUploader completed in 73.42s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.76s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-ca18-c13f-linear-65808-v8
Waiting for inference service chaiml-ca18-c13f-linear-65808-v8 to be ready
Inference service chaiml-ca18-c13f-linear-65808-v8 ready after 150.45706963539124s
Pipeline stage VLLMDeployer completed in 151.03s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.2321877479553223s
Received healthy response to inference request in 1.6387457847595215s
Received healthy response to inference request in 1.656907558441162s
Received healthy response to inference request in 1.5728230476379395s
Received healthy response to inference request in 1.7263212203979492s
Received healthy response to inference request in 1.5570759773254395s
Received healthy response to inference request in 2.522233247756958s
Received healthy response to inference request in 1.9654757976531982s
Received healthy response to inference request in 1.853008508682251s
Received healthy response to inference request in 1.6951994895935059s
Received healthy response to inference request in 2.126722812652588s
Received healthy response to inference request in 1.6687078475952148s
Received healthy response to inference request in 1.5191431045532227s
Received healthy response to inference request in 1.602139949798584s
Received healthy response to inference request in 1.7939560413360596s
Received healthy response to inference request in 1.9152100086212158s
Received healthy response to inference request in 1.9097659587860107s
Received healthy response to inference request in 1.9369330406188965s
Received healthy response to inference request in 1.6499431133270264s
Received healthy response to inference request in 2.17673397064209s
Received healthy response to inference request in 1.565380573272705s
Received healthy response to inference request in 1.5162544250488281s
Received healthy response to inference request in 1.5298433303833008s
Received healthy response to inference request in 2.2272658348083496s
Received healthy response to inference request in 1.7625582218170166s
Received healthy response to inference request in 1.56390380859375s
Received healthy response to inference request in 1.5573606491088867s
Received healthy response to inference request in 1.8201305866241455s
Received healthy response to inference request in 2.3242437839508057s
Received healthy response to inference request in 1.8250808715820312s
30 requests
0 failed requests
5th percentile: 1.5239582061767578
10th percentile: 1.5543527126312255
20th percentile: 1.565085220336914
30th percentile: 1.6277640342712403
40th percentile: 1.6639877319335938
50th percentile: 1.744439721107483
60th percentile: 1.8221107006072998
70th percentile: 1.9113991737365723
80th percentile: 1.9977252006530766
90th percentile: 2.227758026123047
95th percentile: 2.282818567752838
99th percentile: 2.464816303253174
mean time: 1.8137085437774658
Pipeline stage StressChecker completed in 56.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
chaiml-ca18-c13f-linear_65808_v8 status is now deployed due to DeploymentManager action
chaiml-ca18-c13f-linear_65808_v8 status is now inactive due to system request