developer_uid: chai_backend_admin
submission_id: chaiml-02f4-69d4-linear_30131_v6
model_name: chaiml-02f4-69d4-linear_30131_v6
model_group: ChaiML/02f4-69d4-linear-
status: inactive
timestamp: 2026-02-11T19:04:42+00:00
num_battles: 1190
num_wins: 614
celo_rating: 9999.0
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/02f4-69d4-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-02f4-69d4-linear_30131_v6
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/02f4-69d4-linear-w01-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-02-11
win_ratio: 0.5159663865546219
generation_params: {'temperature': 0.7, 'top_p': 0.95, 'min_p': 0.025, 'top_k': 80, 'presence_penalty': 0.4, 'frequency_penalty': 0.4, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-02f4-69d4-linear-30131-v6-uploader
Waiting for job on chaiml-02f4-69d4-linear-30131-v6-uploader to finish
chaiml-02f4-69d4-linear-30131-v6-uploader: Using quantization_mode: fp8
chaiml-02f4-69d4-linear-30131-v6-uploader: Repo ChaiML/02f4-69d4-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-02f4-69d4-linear-30131-v6-uploader: Checking if ChaiML/02f4-69d4-linear-w01-FP8 already exists in ChaiML
chaiml-02f4-69d4-linear-30131-v6-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-02f4-69d4-linear-30131-v6-uploader: Downloading snapshot of ChaiML/02f4-69d4-linear-w01-FP8...
chaiml-02f4-69d4-linear-30131-v6-uploader: Downloaded in 16.092s
chaiml-02f4-69d4-linear-30131-v6-uploader: Processed model ChaiML/02f4-69d4-linear-w01-FP8 in 19.569s
chaiml-02f4-69d4-linear-30131-v6-uploader: creating bucket guanaco-vllm-models
chaiml-02f4-69d4-linear-30131-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v6-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-02f4-69d4-linear-30131-v6-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-02f4-69d4-linear-30131-v6-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-02f4-69d4-linear-30131-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v6-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-02f4-69d4-linear-30131-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v6-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-02f4-69d4-linear-30131-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v6-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-02f4-69d4-linear-30131-v6-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v6-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-02f4-69d4-linear-30131-v6-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-02f4-69d4-linear-30131-v6-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-02f4-69d4-linear-30131-v6-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-02f4-69d4-linear-30131-v6-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-02f4-69d4-linear-30131-v6-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-02f4-69d4-linear-30131-v6-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/.gitattributes
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/config.json
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/generation_config.json
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/recipe.yaml
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/tokenizer_config.json
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/special_tokens_map.json
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/model.safetensors.index.json
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/tokenizer.json
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/model-00006-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/model-00005-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/model-00001-of-00006.safetensors
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/model-00004-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/model-00002-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v6-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v6/default/model-00003-of-00006.safetensors
Job chaiml-02f4-69d4-linear-30131-v6-uploader completed after 104.68s with status: succeeded
Stopping job with name chaiml-02f4-69d4-linear-30131-v6-uploader
Pipeline stage VLLMUploader completed in 105.36s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.23s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-02f4-69d4-linear-30131-v6
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
Waiting for inference service chaiml-02f4-69d4-linear-30131-v6 to be ready
Inference service chaiml-02f4-69d4-linear-30131-v6 ready after 151.19793462753296s
Pipeline stage VLLMDeployer completed in 152.40s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.2259950637817383s
Received healthy response to inference request in 2.7745230197906494s
Received healthy response to inference request in 2.817765235900879s
Received healthy response to inference request in 2.7481024265289307s
Received healthy response to inference request in 2.7926907539367676s
Received healthy response to inference request in 2.8969366550445557s
Received healthy response to inference request in 2.910327911376953s
Received healthy response to inference request in 3.0849838256835938s
Received healthy response to inference request in 2.7419991493225098s
Received healthy response to inference request in 3.074620485305786s
Received healthy response to inference request in 2.821135997772217s
Received healthy response to inference request in 2.77266526222229s
Received healthy response to inference request in 2.810967206954956s
Received healthy response to inference request in 3.1673104763031006s
Received healthy response to inference request in 3.3800294399261475s
Received healthy response to inference request in 3.4095511436462402s
Received healthy response to inference request in 2.687204122543335s
Received healthy response to inference request in 3.0746946334838867s
Received healthy response to inference request in 2.7929694652557373s
Received healthy response to inference request in 3.322824239730835s
Received healthy response to inference request in 2.882991313934326s
Received healthy response to inference request in 2.815979242324829s
Received healthy response to inference request in 3.0281243324279785s
Received healthy response to inference request in 2.786975145339966s
Received healthy response to inference request in 3.11818790435791s
Received healthy response to inference request in 2.766876697540283s
Received healthy response to inference request in 2.9289298057556152s
Received healthy response to inference request in 2.707069158554077s
Received healthy response to inference request in 2.7848029136657715s
Received healthy response to inference request in 2.925990343093872s
30 requests
0 failed requests
5th percentile: 2.722787654399872
10th percentile: 2.7474920988082885
20th percentile: 2.7741514682769775
30th percentile: 2.790976071357727
40th percentile: 2.8139744281768797
50th percentile: 2.8520636558532715
60th percentile: 2.9165928840637205
70th percentile: 3.0420731782913206
80th percentile: 3.091624641418457
90th percentile: 3.2356779813766483
95th percentile: 3.3542870998382566
99th percentile: 3.4009898495674133
mean time: 2.935107445716858
Pipeline stage StressChecker completed in 90.58s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
Shutdown handler de-registered
chaiml-02f4-69d4-linear_30131_v6 status is now deployed due to DeploymentManager action
chaiml-02f4-69d4-linear_30131_v6 status is now inactive due to system request