developer_uid: chai_backend_admin
submission_id: chaiml-2a6f-69d4-linear-w01_v29
model_name: chaiml-2a6f-69d4-linear-w01_v29
model_group: ChaiML/2a6f-69d4-linear-
status: inactive
timestamp: 2026-02-17T21:37:54+00:00
num_battles: 10346
num_wins: 5164
celo_rating: 1298.24
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/2a6f-69d4-linear-w01
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 7
max_input_tokens: 1280
max_output_tokens: 64
reward_model: chaiml-llama31-mer-v2-_44570_v85
display_name: chaiml-2a6f-69d4-linear-w01_v29
is_internal_developer: True
language_model: ChaiML/2a6f-69d4-linear-w01
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-17
win_ratio: 0.4991300985888266
generation_params: {'temperature': 0.9, 'top_p': 0.95, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.45, 'frequency_penalty': 0.45, 'stopping_words': ['\n'], 'max_input_tokens': 1280, 'best_of': 7, 'max_output_tokens': 64}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-2a6f-69d4-linear-w01-v29-uploader
Waiting for job on chaiml-2a6f-69d4-linear-w01-v29-uploader to finish
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
chaiml-2a6f-69d4-linear-w01-v29-uploader: Using quantization_mode: fp8
chaiml-2a6f-69d4-linear-w01-v29-uploader: Checking if ChaiML/2a6f-69d4-linear-w01-FP8 already exists in ChaiML
chaiml-2a6f-69d4-linear-w01-v29-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-2a6f-69d4-linear-w01-v29-uploader: Downloading snapshot of ChaiML/2a6f-69d4-linear-w01-FP8...
chaiml-2a6f-69d4-linear-w01-v29-uploader: Downloaded in 12.395s
chaiml-2a6f-69d4-linear-w01-v29-uploader: Processed model ChaiML/2a6f-69d4-linear-w01 in 15.956s
chaiml-2a6f-69d4-linear-w01-v29-uploader: creating bucket guanaco-vllm-models
chaiml-2a6f-69d4-linear-w01-v29-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-w01-v29-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-2a6f-69d4-linear-w01-v29-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-2a6f-69d4-linear-w01-v29-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-2a6f-69d4-linear-w01-v29-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-w01-v29-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-2a6f-69d4-linear-w01-v29-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-w01-v29-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-2a6f-69d4-linear-w01-v29-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-w01-v29-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-2a6f-69d4-linear-w01-v29-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-2a6f-69d4-linear-w01-v29-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-2a6f-69d4-linear-w01-v29-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-2a6f-69d4-linear-w01-v29-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-2a6f-69d4-linear-w01-v29-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-2a6f-69d4-linear-w01-v29-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-2a6f-69d4-linear-w01-v29-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-2a6f-69d4-linear-w01-v29-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-w01-v29/default
chaiml-2a6f-69d4-linear-w01-v29-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-w01-v29/default/.gitattributes
chaiml-2a6f-69d4-linear-w01-v29-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-w01-v29/default/model-00006-of-00006.safetensors
chaiml-2a6f-69d4-linear-w01-v29-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-w01-v29/default/model-00005-of-00006.safetensors
chaiml-2a6f-69d4-linear-w01-v29-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-w01-v29/default/model-00002-of-00006.safetensors
chaiml-2a6f-69d4-linear-w01-v29-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-w01-v29/default/model-00003-of-00006.safetensors
chaiml-2a6f-69d4-linear-w01-v29-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-w01-v29/default/model-00004-of-00006.safetensors
chaiml-2a6f-69d4-linear-w01-v29-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-2a6f-69d4-linear-w01-v29/default/model-00001-of-00006.safetensors
Job chaiml-2a6f-69d4-linear-w01-v29-uploader completed after 124.69s with status: succeeded
Stopping job with name chaiml-2a6f-69d4-linear-w01-v29-uploader
Pipeline stage VLLMUploader completed in 125.35s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.16s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-2a6f-69d4-linear-w01-v29
Waiting for inference service chaiml-2a6f-69d4-linear-w01-v29 to be ready
Failed to get response for submission chaiml-mistral-24b-2048_15988_v1: ('http://chaiml-mistral-24b-2048-15988-v1-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/models/GPT-J-6B-lit-v2:predict', '')
HTTP Request: %s %s "%s %d %s"
Inference service chaiml-2a6f-69d4-linear-w01-v29 ready after 201.4608292579651s
Pipeline stage VLLMDeployer completed in 202.39s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.4804508686065674s
Received healthy response to inference request in 1.552701473236084s
Received healthy response to inference request in 1.3975286483764648s
Received healthy response to inference request in 1.4336276054382324s
Received healthy response to inference request in 1.3711180686950684s
Received healthy response to inference request in 1.496800184249878s
Received healthy response to inference request in 1.4540152549743652s
Received healthy response to inference request in 1.374194860458374s
Received healthy response to inference request in 1.6315622329711914s
Received healthy response to inference request in 1.8420155048370361s
Received healthy response to inference request in 1.665374755859375s
Received healthy response to inference request in 2.2556769847869873s
Received healthy response to inference request in 1.6366963386535645s
Received healthy response to inference request in 1.445410966873169s
Received healthy response to inference request in 1.5450084209442139s
Received healthy response to inference request in 1.6121258735656738s
Received healthy response to inference request in 1.465867042541504s
Received healthy response to inference request in 1.4541151523590088s
Received healthy response to inference request in 1.4102528095245361s
Received healthy response to inference request in 1.5272164344787598s
Received healthy response to inference request in 1.3879079818725586s
Received healthy response to inference request in 1.4741370677947998s
Received healthy response to inference request in 1.5455522537231445s
Received healthy response to inference request in 1.5071372985839844s
Received healthy response to inference request in 1.6850028038024902s
Received healthy response to inference request in 1.9959564208984375s
Received healthy response to inference request in 2.002474308013916s
Received healthy response to inference request in 1.5366225242614746s
Received healthy response to inference request in 1.577747106552124s
Received healthy response to inference request in 1.4751918315887451s
30 requests
0 failed requests
5th percentile: 1.3803657650947572
10th percentile: 1.3965665817260742
20th percentile: 1.4430542945861817
30th percentile: 1.4623414754867554
40th percentile: 1.4783472537994384
50th percentile: 1.517176866531372
60th percentile: 1.5452259540557862
70th percentile: 1.588060736656189
80th percentile: 1.6424320220947266
90th percentile: 1.8574095964431765
95th percentile: 1.9995412588119508
99th percentile: 2.1822482085227968
mean time: 1.5746496359507243
Pipeline stage StressChecker completed in 51.17s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
chaiml-2a6f-69d4-linear-w01_v29 status is now deployed due to DeploymentManager action
chaiml-2a6f-69d4-linear-w01_v29 status is now inactive due to auto deactivation removed underperforming models