developer_uid: chai_backend_admin
submission_id: chaiml-02f4-69d4-linear_30131_v7
model_name: chaiml-02f4-69d4-linear_30131_v7
model_group: ChaiML/02f4-69d4-linear-
status: torndown
timestamp: 2026-03-08T18:03:37+00:00
num_battles: 2287
num_wins: 1174
celo_rating: 9278.51
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/02f4-69d4-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 8
max_input_tokens: 1024
max_output_tokens: 64
reward_model: default
display_name: chaiml-02f4-69d4-linear_30131_v7
ineligible_reason: num_battles<10000
is_internal_developer: True
language_model: ChaiML/02f4-69d4-linear-w01-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-05
win_ratio: 0.5133362483602973
generation_params: {'temperature': 0.7, 'top_p': 0.95, 'min_p': 0.025, 'top_k': 80, 'presence_penalty': 0.4, 'frequency_penalty': 0.4, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '<|im_start|>system\n{memory}<|im_end|>\n', 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{user_name}: {message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-02f4-69d4-linear-30131-v7-uploader
Waiting for job on chaiml-02f4-69d4-linear-30131-v7-uploader to finish
chaiml-02f4-69d4-linear-30131-v7-uploader: Using quantization_mode: fp8
chaiml-02f4-69d4-linear-30131-v7-uploader: Repo ChaiML/02f4-69d4-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-02f4-69d4-linear-30131-v7-uploader: Checking if ChaiML/02f4-69d4-linear-w01-FP8 already exists in ChaiML
chaiml-02f4-69d4-linear-30131-v7-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-02f4-69d4-linear-30131-v7-uploader: Downloading snapshot of ChaiML/02f4-69d4-linear-w01-FP8...
chaiml-02f4-69d4-linear-30131-v7-uploader: Downloaded in 12.822s
chaiml-02f4-69d4-linear-30131-v7-uploader: Processed model ChaiML/02f4-69d4-linear-w01-FP8 in 16.353s
chaiml-02f4-69d4-linear-30131-v7-uploader: creating bucket guanaco-vllm-models
chaiml-02f4-69d4-linear-30131-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v7-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-02f4-69d4-linear-30131-v7-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-02f4-69d4-linear-30131-v7-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-02f4-69d4-linear-30131-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v7-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-02f4-69d4-linear-30131-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v7-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-02f4-69d4-linear-30131-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v7-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-02f4-69d4-linear-30131-v7-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-02f4-69d4-linear-30131-v7-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-02f4-69d4-linear-30131-v7-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-02f4-69d4-linear-30131-v7-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-02f4-69d4-linear-30131-v7-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-02f4-69d4-linear-30131-v7-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-02f4-69d4-linear-30131-v7-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-02f4-69d4-linear-30131-v7-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/generation_config.json
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/model.safetensors.index.json
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/recipe.yaml
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/tokenizer_config.json
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/.gitattributes
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/special_tokens_map.json
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/config.json
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/tokenizer.json
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/model-00006-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/model-00005-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/model-00001-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/model-00004-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/model-00002-of-00006.safetensors
chaiml-02f4-69d4-linear-30131-v7-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-02f4-69d4-linear-30131-v7/default/model-00003-of-00006.safetensors
Job chaiml-02f4-69d4-linear-30131-v7-uploader completed after 83.08s with status: succeeded
Stopping job with name chaiml-02f4-69d4-linear-30131-v7-uploader
Pipeline stage VLLMUploader completed in 83.61s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.86s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-02f4-69d4-linear-30131-v7
Waiting for inference service chaiml-02f4-69d4-linear-30131-v7 to be ready
Inference service chaiml-02f4-69d4-linear-30131-v7 ready after 130.3368935585022s
Pipeline stage VLLMDeployer completed in 130.85s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.4921929836273193s
Received healthy response to inference request in 2.850651502609253s
Received healthy response to inference request in 3.5730834007263184s
Received healthy response to inference request in 3.2887918949127197s
Received healthy response to inference request in 2.9145543575286865s
Received healthy response to inference request in 2.807434320449829s
Received healthy response to inference request in 2.689898729324341s
Received healthy response to inference request in 2.728238821029663s
Received healthy response to inference request in 2.7088301181793213s
Received healthy response to inference request in 3.362232208251953s
Received healthy response to inference request in 2.9099457263946533s
Received healthy response to inference request in 2.978313446044922s
Received healthy response to inference request in 3.1101675033569336s
Received healthy response to inference request in 3.5862152576446533s
Received healthy response to inference request in 3.023106575012207s
Received healthy response to inference request in 2.966017007827759s
Received healthy response to inference request in 3.374804735183716s
Received healthy response to inference request in 3.179222822189331s
Received healthy response to inference request in 3.2002463340759277s
Received healthy response to inference request in 2.8615851402282715s
Received healthy response to inference request in 2.742187976837158s
Received healthy response to inference request in 2.7857415676116943s
Received healthy response to inference request in 2.8614745140075684s
Received healthy response to inference request in 3.329159736633301s
Received healthy response to inference request in 3.034980058670044s
Received healthy response to inference request in 3.245645046234131s
Received healthy response to inference request in 3.188948631286621s
Received healthy response to inference request in 2.9774012565612793s
Received healthy response to inference request in 2.999091625213623s
Received healthy response to inference request in 2.778074264526367s
30 requests
0 failed requests
5th percentile: 2.717564034461975
10th percentile: 2.740793061256409
20th percentile: 2.8030957698822023
30th percentile: 2.8615519523620607
40th percentile: 2.94543194770813
50th percentile: 2.9887025356292725
60th percentile: 3.0650550365447997
70th percentile: 3.1923379421234133
80th percentile: 3.296865463256836
90th percentile: 3.3865435600280764
95th percentile: 3.5366827130317686
99th percentile: 3.582407019138336
mean time: 3.051607918739319
Pipeline stage StressChecker completed in 95.78s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.72s
Shutdown handler de-registered
chaiml-02f4-69d4-linear_30131_v7 status is now deployed due to DeploymentManager action
chaiml-02f4-69d4-linear_30131_v7 status is now inactive due to system request
Deleting key chaiml-ca18-c13f-linear-65808-v7/default/tokenizer_config.json from bucket guanaco-vllm-models
chaiml-02f4-69d4-linear_30131_v7 status is now torndown due to DeploymentManager action