developer_uid: Meliodia
submission_id: chaiml-2fe5-c13f-linea_57126_v10
model_name: chaiml-2fe5-c13f-linear_57126_v4
model_group: ChaiML/2fe5-c13f-linear-
status: torndown
timestamp: 2026-03-27T22:02:47+00:00
num_battles: 13394
num_wins: 6574
celo_rating: 8478.26
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/2fe5-c13f-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 10
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-2fe5-c13f-linear_57126_v4
is_internal_developer: True
language_model: ChaiML/2fe5-c13f-linear-w01-FP8
model_size: 13B
ranking_group: single
us_pacific_date: 2026-03-24
win_ratio: 0.4908167836344632
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', 'You:', 'Bot:', '</s>', '<|im_end|>', 'User:', '\n', '<|eot_id|>'], 'max_input_tokens': 1024, 'best_of': 10, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-2fe5-c13f-linea-57126-v10-uploader
Waiting for job on chaiml-2fe5-c13f-linea-57126-v10-uploader to finish
chaiml-2fe5-c13f-linea-57126-v10-uploader: Using quantization_mode: fp8
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-2fe5-c13f-linea-57126-v12-uploader
Waiting for job on chaiml-2fe5-c13f-linea-57126-v12-uploader to finish
chaiml-2fe5-c13f-linea-57126-v10-uploader: Repo ChaiML/2fe5-c13f-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-2fe5-c13f-linea-57126-v10-uploader: Checking if ChaiML/2fe5-c13f-linear-w01-FP8 already exists in ChaiML
chaiml-2fe5-c13f-linea-57126-v10-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-2fe5-c13f-linea-57126-v10-uploader: Downloading snapshot of ChaiML/2fe5-c13f-linear-w01-FP8...
2026-03-24T20:52:51.935562+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v10
chaiml-2fe5-c13f-linea-57126-v10-uploader: Downloaded in 11.123s
chaiml-2fe5-c13f-linea-57126-v10-uploader: Processed model ChaiML/2fe5-c13f-linear-w01-FP8 in 14.715s
chaiml-2fe5-c13f-linea-57126-v10-uploader: creating bucket guanaco-vllm-models
chaiml-2fe5-c13f-linea-57126-v10-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v10-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-2fe5-c13f-linea-57126-v10-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-2fe5-c13f-linea-57126-v10-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-2fe5-c13f-linea-57126-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v10-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v10-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v10-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-2fe5-c13f-linea-57126-v10-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v10-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-2fe5-c13f-linea-57126-v10-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-2fe5-c13f-linea-57126-v10-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v10-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-2fe5-c13f-linea-57126-v10-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-2fe5-c13f-linea-57126-v10-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-2fe5-c13f-linea-57126-v10-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/special_tokens_map.json
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/model.safetensors.index.json
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/config.json
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/recipe.yaml
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/tokenizer_config.json
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/README.md
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/chat_template.jinja
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/generation_config.json
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/.gitattributes
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/tokenizer.json
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/model-00003-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/model-00003-of-00003.safetensors
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/model-00002-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/model-00002-of-00003.safetensors
chaiml-2fe5-c13f-linea-57126-v10-uploader: cp /dev/shm/model_output/model-00001-of-00003.safetensors s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v10/default/model-00001-of-00003.safetensors
Job chaiml-2fe5-c13f-linea-57126-v10-uploader completed after 74.41s with status: succeeded
Stopping job with name chaiml-2fe5-c13f-linea-57126-v10-uploader
Pipeline stage VLLMUploader completed in 75.02s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 4.41s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-2fe5-c13f-linea-57126-v10
Waiting for inference service chaiml-2fe5-c13f-linea-57126-v10 to be ready
chaiml-2fe5-c13f-linea-57126-v12-uploader: Using quantization_mode: fp8
chaiml-2fe5-c13f-linea-57126-v12-uploader: Repo ChaiML/2fe5-c13f-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-2fe5-c13f-linea-57126-v12-uploader: Checking if ChaiML/2fe5-c13f-linear-w01-FP8 already exists in ChaiML
chaiml-2fe5-c13f-linea-57126-v12-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-2fe5-c13f-linea-57126-v12-uploader: Downloading snapshot of ChaiML/2fe5-c13f-linear-w01-FP8...
chaiml-2fe5-c13f-linea-57126-v12-uploader: Downloaded in 5.984s
chaiml-2fe5-c13f-linea-57126-v12-uploader: Processed model ChaiML/2fe5-c13f-linear-w01-FP8 in 9.451s
chaiml-2fe5-c13f-linea-57126-v12-uploader: creating bucket guanaco-vllm-models
chaiml-2fe5-c13f-linea-57126-v12-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v12-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-2fe5-c13f-linea-57126-v12-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-2fe5-c13f-linea-57126-v12-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-2fe5-c13f-linea-57126-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v12-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v12-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v12-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-2fe5-c13f-linea-57126-v12-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-2fe5-c13f-linea-57126-v12-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-2fe5-c13f-linea-57126-v12-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-2fe5-c13f-linea-57126-v12-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-2fe5-c13f-linea-57126-v12-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-2fe5-c13f-linea-57126-v12-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-2fe5-c13f-linea-57126-v12-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-2fe5-c13f-linea-57126-v12-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/.gitattributes
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/tokenizer_config.json
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/generation_config.json
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/special_tokens_map.json
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/config.json
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/README.md
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/chat_template.jinja
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/recipe.yaml
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/model.safetensors.index.json
chaiml-2fe5-c13f-linea-57126-v12-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-2fe5-c13f-linea-57126-v12/default/tokenizer.json
2026-03-24T20:53:36.484851+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v12
Job chaiml-2fe5-c13f-linea-57126-v12-uploader completed after 64.3s with status: succeeded
Stopping job with name chaiml-2fe5-c13f-linea-57126-v12-uploader
Pipeline stage VLLMUploader completed in 64.98s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.42s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-2fe5-c13f-linea-57126-v12
Waiting for inference service chaiml-2fe5-c13f-linea-57126-v12 to be ready
2026-03-24T20:53:52.092941+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v10
2026-03-24T20:54:36.621913+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v12
2026-03-24T20:54:52.229097+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v10
2026-03-24T20:55:36.769297+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v12
2026-03-24T20:55:52.370084+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v10
Inference service chaiml-2fe5-c13f-linea-57126-v10 ready after 161.0645833015442s
Pipeline stage VLLMDeployer completed in 162.31s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.2403564453125s
Received healthy response to inference request in 3.185228109359741s
Received healthy response to inference request in 3.224674940109253s
Received healthy response to inference request in 1.6373159885406494s
Received healthy response to inference request in 1.6549901962280273s
Received healthy response to inference request in 1.62211012840271s
Received healthy response to inference request in 1.7398858070373535s
Received healthy response to inference request in 1.6669228076934814s
Received healthy response to inference request in 2.1017801761627197s
Received healthy response to inference request in 1.6890919208526611s
Received healthy response to inference request in 3.193406105041504s
Received healthy response to inference request in 3.1882874965667725s
Inference service chaiml-2fe5-c13f-linea-57126-v12 ready after 160.90617966651917s
Pipeline stage VLLMDeployer completed in 161.66s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.7325069904327393s
Received healthy response to inference request in 1.6911084651947021s
Received healthy response to inference request in 3.4653420448303223s
Received healthy response to inference request in 1.6481857299804688s
Received healthy response to inference request in 1.7960498332977295s
Received healthy response to inference request in 3.149184465408325s
Received healthy response to inference request in 1.9285197257995605s
Received healthy response to inference request in 3.31771183013916s
Received healthy response to inference request in 1.7934706211090088s
Received healthy response to inference request in 1.632551670074463s
2026-03-24T20:56:36.918565+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v12
Received healthy response to inference request in 1.685401439666748s
Received healthy response to inference request in 1.5750479698181152s
Received healthy response to inference request in 1.6046111583709717s
Received healthy response to inference request in 1.7347025871276855s
Received healthy response to inference request in 1.6233468055725098s
Received healthy response to inference request in 1.6208486557006836s
Received healthy response to inference request in 1.6136696338653564s
Received healthy response to inference request in 1.774627447128296s
Received healthy response to inference request in 1.727524757385254s
Received healthy response to inference request in 1.967695713043213s
Received healthy response to inference request in 1.7511849403381348s
Received healthy response to inference request in 1.6291992664337158s
Received healthy response to inference request in 3.2495594024658203s
Received healthy response to inference request in 1.7326130867004395s
Received healthy response to inference request in 2.1373403072357178s
Received healthy response to inference request in 1.8849461078643799s
2026-03-24T20:56:52.511222+00:00 monitor updated for chaiml-2fe5-c13f-linea_57126_v10
Received healthy response to inference request in 1.6264572143554688s
Received healthy response to inference request in 1.6488549709320068s
Received healthy response to inference request in 1.6467747688293457s
Received healthy response to inference request in 1.6994657516479492s
Received healthy response to inference request in 3.7313921451568604s
30 requests
0 failed requests
5th percentile: 1.6174678564071656
10th percentile: 1.6232231378555297
20th percentile: 1.6448830127716065
30th percentile: 1.653149628639221
40th percentile: 1.687615728378296
50th percentile: 1.7134952545166016
60th percentile: 1.735522174835205
70th percentile: 1.794244384765625
80th percentile: 1.963171815872193
90th percentile: 3.1887993574142457
95th percentile: 3.2106039643287656
Received healthy response to inference request in 1.5977883338928223s
99th percentile: 3.2358088088035584
mean time: 1.9660494724909465
Pipeline stage StressChecker completed in 65.12s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 1.7967243194580078s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.55s
Shutdown handler de-registered
chaiml-2fe5-c13f-linea_57126_v10 status is now deployed due to DeploymentManager action
chaiml-2fe5-c13f-linea_57126_v10 status is now inactive due to auto deactivation removed underperforming models
chaiml-2fe5-c13f-linea_57126_v10 status is now torndown due to DeploymentManager action