developer_uid: Meliodia
submission_id: chaiml-2fe5-c13f-linea_57126_v13
model_name: chaiml-2fe5-c13f-linear_57126_v4
model_group: ChaiML/2fe5-c13f-linear-
status: torndown
timestamp: 2026-04-03T23:42:04+00:00
num_battles: 12656
num_wins: 6360
celo_rating: 8478.26
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/2fe5-c13f-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 16
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-2fe5-c13f-linear_57126_v4
is_internal_developer: True
language_model: ChaiML/2fe5-c13f-linear-w01-FP8
model_size: 13B
ranking_group: single
us_pacific_date: 2026-03-24
win_ratio: 0.5025284450063211
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', 'You:', '\n', '</s>', 'User:', '<|eot_id|>', '<|im_end|>', 'Bot:'], 'max_input_tokens': 1024, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-2fe5-c13f-linea-57126-v13-uploader
Waiting for job on chaiml-2fe5-c13f-linea-57126-v13-uploader to finish
chaiml-2fe5-c13f-linea-57126-v13-uploader: Using quantization_mode: fp8
chaiml-2fe5-c13f-linea-57126-v13-uploader: Repo ChaiML/2fe5-c13f-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-2fe5-c13f-linea-57126-v13-uploader: Checking if ChaiML/2fe5-c13f-linear-w01-FP8 already exists in ChaiML
chaiml-2fe5-c13f-linea-57126-v13-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-2fe5-c13f-linea-57126-v13-uploader: Downloading snapshot of ChaiML/2fe5-c13f-linear-w01-FP8...
chaiml-2fe5-c13f-linea-57126-v13-uploader: Downloaded in 6.955s
chaiml-2fe5-c13f-linea-57126-v13-uploader: Processed model ChaiML/2fe5-c13f-linear-w01-FP8 in 10.443s
chaiml-2fe5-c13f-linea-57126-v13-uploader: creating bucket guanaco-vllm-models
chaiml-2fe5-c13f-linea-57126-v13-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v13-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-2fe5-c13f-linea-57126-v13-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-2fe5-c13f-linea-57126-v13-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-2fe5-c13f-linea-57126-v13-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v13-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v13-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v13-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v13-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v13-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-2fe5-c13f-linea-57126-v13-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v13-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-2fe5-c13f-linea-57126-v13-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-2fe5-c13f-linea-57126-v13-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v13-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-2fe5-c13f-linea-57126-v13-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-2fe5-c13f-linea-57126-v13-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-2fe5-c13f-linea-57126-v13-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/.gitattributes
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/README.md
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/config.json
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/recipe.yaml
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/model.safetensors.index.json
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/chat_template.jinja
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/generation_config.json
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/tokenizer_config.json
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/special_tokens_map.json
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/tokenizer.json
2026-03-24T20:55:20.148777+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v13
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/model-00001-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/model-00001-of-00003.safetensors
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/model-00003-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/model-00003-of-00003.safetensors
chaiml-2fe5-c13f-linea-57126-v13-uploader: cp /dev/shm/model_output/model-00002-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v13/default/model-00002-of-00003.safetensors
Job chaiml-2fe5-c13f-linea-57126-v13-uploader completed after 82.74s with status: succeeded
Stopping job with name chaiml-2fe5-c13f-linea-57126-v13-uploader
Pipeline stage VLLMUploader completed in 83.24s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.04s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-2fe5-c13f-linea-57126-v13
Waiting for inference service chaiml-2fe5-c13f-linea-57126-v13 to be ready
2026-03-24T20:56:25.699438+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v13
2026-03-24T20:57:25.792724+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v13
2026-03-24T20:58:25.893991+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v13
Inference service chaiml-2fe5-c13f-linea-57126-v13 ready after 160.4875009059906s
Pipeline stage VLLMDeployer completed in 160.99s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.023160696029663s
Received healthy response to inference request in 4.675499439239502s
Received healthy response to inference request in 4.91327691078186s
Received healthy response to inference request in 1.6625242233276367s
Received healthy response to inference request in 1.7109858989715576s
Received healthy response to inference request in 1.8490912914276123s
Received healthy response to inference request in 4.685931921005249s
Received healthy response to inference request in 1.6546449661254883s
Received healthy response to inference request in 1.7377352714538574s
Received healthy response to inference request in 1.9075310230255127s
Received healthy response to inference request in 1.9636101722717285s
Received healthy response to inference request in 1.6621997356414795s
Received healthy response to inference request in 1.915956974029541s
Received healthy response to inference request in 1.6514294147491455s
Received healthy response to inference request in 1.7052772045135498s
Received healthy response to inference request in 1.7983996868133545s
Received healthy response to inference request in 1.6440858840942383s
Received healthy response to inference request in 1.6493439674377441s
Received healthy response to inference request in 1.675140142440796s
Received healthy response to inference request in 1.7097508907318115s
Received healthy response to inference request in 1.885472297668457s
Received healthy response to inference request in 1.680593729019165s
Received healthy response to inference request in 1.80336594581604s
Received healthy response to inference request in 1.9023888111114502s
Received healthy response to inference request in 1.6551730632781982s
2026-03-24T20:59:25.991904+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v13
Received healthy response to inference request in 1.8030681610107422s
Received healthy response to inference request in 1.7645297050476074s
Received healthy response to inference request in 1.9352421760559082s
Received healthy response to inference request in 4.652250289916992s
Received healthy response to inference request in 1.7782881259918213s
30 requests
0 failed requests
5th percentile: 1.6502824187278748
10th percentile: 1.654323410987854
20th percentile: 1.6624593257904052
30th percentile: 1.6978721618652344
40th percentile: 1.7270355224609375
50th percentile: 1.788343906402588
60th percentile: 1.8216560840606688
70th percentile: 1.903931474685669
80th percentile: 1.9409157752990724
90th percentile: 4.6765426874160765
95th percentile: 4.810971665382384
99th percentile: 4.9912943983078
mean time: 2.268531600634257
Pipeline stage StressChecker completed in 70.50s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
chaiml-2fe5-c13f-linea_57126_v13 status is now deployed due to DeploymentManager action
chaiml-2fe5-c13f-linea_57126_v13 status is now inactive due to auto deactivation removed underperforming models
chaiml-2fe5-c13f-linea_57126_v13 status is now torndown due to DeploymentManager action