developer_uid: Meliodia
submission_id: chaiml-2fe5-c13f-linea_57126_v14
model_name: chaiml-2fe5-c13f-linear_57126_v4
model_group: ChaiML/2fe5-c13f-linear-
status: torndown
timestamp: 2026-03-27T23:42:18+00:00
num_battles: 12567
num_wins: 6387
celo_rating: 8477.39
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/2fe5-c13f-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 16
max_input_tokens: 1500
max_output_tokens: 64
reward_model: default
display_name: chaiml-2fe5-c13f-linear_57126_v4
is_internal_developer: True
language_model: ChaiML/2fe5-c13f-linear-w01-FP8
model_size: 13B
ranking_group: single
us_pacific_date: 2026-03-24
win_ratio: 0.5082358558128431
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|eot_id|>', 'Bot:', '####', '\n', '</s>', 'You:', '<|im_end|>', 'User:'], 'max_input_tokens': 1500, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-2fe5-c13f-linea-57126-v14-uploader
Waiting for job on chaiml-2fe5-c13f-linea-57126-v14-uploader to finish
chaiml-2fe5-c13f-linea-57126-v14-uploader: Using quantization_mode: fp8
chaiml-2fe5-c13f-linea-57126-v14-uploader: Repo ChaiML/2fe5-c13f-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-2fe5-c13f-linea-57126-v14-uploader: Checking if ChaiML/2fe5-c13f-linear-w01-FP8 already exists in ChaiML
chaiml-2fe5-c13f-linea-57126-v14-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-2fe5-c13f-linea-57126-v14-uploader: Downloading snapshot of ChaiML/2fe5-c13f-linear-w01-FP8...
chaiml-2fe5-c13f-linea-57126-v14-uploader: Downloaded in 5.637s
chaiml-2fe5-c13f-linea-57126-v14-uploader: Processed model ChaiML/2fe5-c13f-linear-w01-FP8 in 9.119s
chaiml-2fe5-c13f-linea-57126-v14-uploader: creating bucket guanaco-vllm-models
chaiml-2fe5-c13f-linea-57126-v14-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v14-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-2fe5-c13f-linea-57126-v14-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-2fe5-c13f-linea-57126-v14-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-2fe5-c13f-linea-57126-v14-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v14-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v14-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v14-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v14-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v14-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-2fe5-c13f-linea-57126-v14-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v14-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-2fe5-c13f-linea-57126-v14-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-2fe5-c13f-linea-57126-v14-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v14-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-2fe5-c13f-linea-57126-v14-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-2fe5-c13f-linea-57126-v14-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-2fe5-c13f-linea-57126-v14-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/.gitattributes
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/generation_config.json
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/recipe.yaml
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/model.safetensors.index.json
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/tokenizer_config.json
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/README.md
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/special_tokens_map.json
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/chat_template.jinja
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/config.json
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/tokenizer.json
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/model-00003-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/model-00003-of-00003.safetensors
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/model-00002-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/model-00002-of-00003.safetensors
chaiml-2fe5-c13f-linea-57126-v14-uploader: cp /dev/shm/model_output/model-00001-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v14/default/model-00001-of-00003.safetensors
Job chaiml-2fe5-c13f-linea-57126-v14-uploader completed after 42.56s with status: succeeded
Stopping job with name chaiml-2fe5-c13f-linea-57126-v14-uploader
Pipeline stage VLLMUploader completed in 43.11s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 11.76s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-2fe5-c13f-linea-57126-v14
Waiting for inference service chaiml-2fe5-c13f-linea-57126-v14 to be ready
2026-03-24T22:15:32.511699+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v14
2026-03-24T22:16:32.612378+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v14
Retrying (%r) after connection broken by '%r': %s
2026-03-24T22:17:32.702414+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v14
Inference service chaiml-2fe5-c13f-linea-57126-v14 ready after 160.58012342453003s
Pipeline stage VLLMDeployer completed in 161.24s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.6648523807525635s
Received healthy response to inference request in 4.710649013519287s
Received healthy response to inference request in 1.7345764636993408s
Received healthy response to inference request in 1.6264095306396484s
Received healthy response to inference request in 4.892063856124878s
Received healthy response to inference request in 4.916025876998901s
2026-03-24T22:18:32.796676+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v14
Received healthy response to inference request in 4.788406610488892s
Received healthy response to inference request in 1.841503381729126s
Received healthy response to inference request in 1.6756110191345215s
Received healthy response to inference request in 1.6623525619506836s
Received healthy response to inference request in 1.8023755550384521s
Received healthy response to inference request in 1.7036755084991455s
Received healthy response to inference request in 1.7017416954040527s
Received healthy response to inference request in 1.754431962966919s
Received healthy response to inference request in 1.7055549621582031s
Received healthy response to inference request in 1.7096993923187256s
Received healthy response to inference request in 1.826653242111206s
Received healthy response to inference request in 1.6656949520111084s
Received healthy response to inference request in 1.7381010055541992s
Received healthy response to inference request in 1.6507680416107178s
Received healthy response to inference request in 1.6808438301086426s
Received healthy response to inference request in 1.754471778869629s
Received healthy response to inference request in 1.7105658054351807s
Received healthy response to inference request in 1.6574687957763672s
Received healthy response to inference request in 1.7612411975860596s
Received healthy response to inference request in 1.6570549011230469s
Received healthy response to inference request in 1.6817421913146973s
Received healthy response to inference request in 1.6707193851470947s
Received healthy response to inference request in 1.7563960552215576s
Received healthy response to inference request in 1.7792820930480957s
30 requests
0 failed requests
5th percentile: 1.6535971283912658
10th percentile: 1.6574274063110352
20th percentile: 1.6697144985198975
30th percentile: 1.6814726829528808
40th percentile: 1.70480318069458
50th percentile: 1.7225711345672607
60th percentile: 1.7544478893280029
70th percentile: 1.7666534662246705
80th percentile: 1.82962327003479
90th percentile: 4.718424773216248
95th percentile: 4.845418095588684
99th percentile: 4.9090768909454345
mean time: 2.2293644348780313
Pipeline stage StressChecker completed in 69.58s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
chaiml-2fe5-c13f-linea_57126_v14 status is now deployed due to DeploymentManager action
chaiml-2fe5-c13f-linea_57126_v14 status is now inactive due to auto deactivation removed underperforming models
chaiml-2fe5-c13f-linea_57126_v14 status is now torndown due to DeploymentManager action