developer_uid: Meliodia
submission_id: chaiml-7b07-69d4-linea_27339_v14
model_name: chaiml-7b07-69d4-linear_27339_v6
model_group: ChaiML/7b07-69d4-linear-
status: torndown
timestamp: 2026-04-03T23:42:06+00:00
num_battles: 25329
num_wins: 11988
celo_rating: 1276.18
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/7b07-69d4-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 16
max_input_tokens: 1440
max_output_tokens: 60
reward_model: default
display_name: chaiml-7b07-69d4-linear_27339_v6
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/7b07-69d4-linear-w01-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.4732914840696435
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.1, 'frequency_penalty': 0.1, 'stopping_words': ['You:', '\n', '####\n', '</s>', '####'], 'max_input_tokens': 1440, 'best_of': 16, 'max_output_tokens': 60}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-7b07-69d4-linea-27339-v14-uploader
Waiting for job on chaiml-7b07-69d4-linea-27339-v14-uploader to finish
chaiml-7b07-69d4-linea-27339-v14-uploader: Using quantization_mode: fp8
chaiml-7b07-69d4-linea-27339-v14-uploader: Repo ChaiML/7b07-69d4-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-7b07-69d4-linea-27339-v14-uploader: Checking if ChaiML/7b07-69d4-linear-w01-FP8 already exists in ChaiML
chaiml-7b07-69d4-linea-27339-v14-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-7b07-69d4-linea-27339-v14-uploader: Downloading snapshot of ChaiML/7b07-69d4-linear-w01-FP8...
2026-03-25T22:20:11.384110+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v14
chaiml-7b07-69d4-linea-27339-v14-uploader: Downloaded in 9.916s
chaiml-7b07-69d4-linea-27339-v14-uploader: Processed model ChaiML/7b07-69d4-linear-w01-FP8 in 13.562s
chaiml-7b07-69d4-linea-27339-v14-uploader: creating bucket guanaco-vllm-models
chaiml-7b07-69d4-linea-27339-v14-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v14-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-7b07-69d4-linea-27339-v14-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-7b07-69d4-linea-27339-v14-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-7b07-69d4-linea-27339-v14-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v14-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-7b07-69d4-linea-27339-v14-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v14-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-7b07-69d4-linea-27339-v14-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v14-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-7b07-69d4-linea-27339-v14-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v14-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-7b07-69d4-linea-27339-v14-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-7b07-69d4-linea-27339-v14-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-7b07-69d4-linea-27339-v14-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-7b07-69d4-linea-27339-v14-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-7b07-69d4-linea-27339-v14-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-7b07-69d4-linea-27339-v14-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/README.md
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/config.json
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/recipe.yaml
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/.gitattributes
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/tokenizer_config.json
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/model.safetensors.index.json
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/special_tokens_map.json
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/generation_config.json
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/tokenizer.json
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/model-00006-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v14-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v14/default/model-00005-of-00006.safetensors
Job chaiml-7b07-69d4-linea-27339-v14-uploader completed after 72.29s with status: succeeded
Stopping job with name chaiml-7b07-69d4-linea-27339-v14-uploader
Pipeline stage VLLMUploader completed in 72.80s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 3.38s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-7b07-69d4-linea-27339-v14
Waiting for inference service chaiml-7b07-69d4-linea-27339-v14 to be ready
2026-03-25T22:21:11.473432+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v14
2026-03-25T22:22:11.560013+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v14
2026-03-25T22:23:11.648074+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v14
Inference service chaiml-7b07-69d4-linea-27339-v14 ready after 170.43831872940063s
Pipeline stage VLLMDeployer completed in 170.99s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.061599016189575s
Received healthy response to inference request in 5.754814386367798s
Failed to get response for submission chaiml-grpo-glm50-chai-_10243_v1: HTTPConnectionPool(host='chaiml-grpo-glm50-chai-10243-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=20.0)
Received healthy response to inference request in 2.861593008041382s
Received healthy response to inference request in 2.5968806743621826s
Received healthy response to inference request in 2.5867972373962402s
Received healthy response to inference request in 5.625950336456299s
Received healthy response to inference request in 2.568035840988159s
Received healthy response to inference request in 3.065000057220459s
Received healthy response to inference request in 2.9376962184906006s
Received healthy response to inference request in 5.656569004058838s
Received healthy response to inference request in 2.591954231262207s
Received healthy response to inference request in 2.722078323364258s
Received healthy response to inference request in 2.9506380558013916s
Received healthy response to inference request in 2.60524845123291s
2026-03-25T22:24:11.801386+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v14
Failed to get response for submission chaiml-grpo-glm50-chai-_10243_v1: ('http://chaiml-grpo-glm50-chai-10243-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com/v1/completions', 'activator request timeout')
Received healthy response to inference request in 5.713465929031372s
Received healthy response to inference request in 2.9795784950256348s
Received healthy response to inference request in 2.7772152423858643s
Received healthy response to inference request in 2.780064821243286s
Received healthy response to inference request in 2.614607095718384s
Received healthy response to inference request in 2.7459168434143066s
Received healthy response to inference request in 3.042469024658203s
Received healthy response to inference request in 2.6947309970855713s
Received healthy response to inference request in 2.593883991241455s
Received healthy response to inference request in 2.6837377548217773s
Received healthy response to inference request in 3.0240020751953125s
Received healthy response to inference request in 2.593724489212036s
Received healthy response to inference request in 2.6188604831695557s
Received healthy response to inference request in 2.8202927112579346s
Received healthy response to inference request in 2.6464033126831055s
Received healthy response to inference request in 2.5818324089050293s
30 requests
0 failed requests
5th percentile: 2.5840665817260744
10th percentile: 2.5914385318756104
20th percentile: 2.596281337738037
30th percentile: 2.617584466934204
40th percentile: 2.690333700180054
50th percentile: 2.7615660429000854
60th percentile: 2.8368128299713136
70th percentile: 2.9593201875686646
80th percentile: 3.0469752311706544
90th percentile: 5.6622586965560915
95th percentile: 5.736207580566406
99th percentile: 5.97263147354126
mean time: 3.2498546838760376
Pipeline stage StressChecker completed in 100.17s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.64s
Shutdown handler de-registered
chaiml-7b07-69d4-linea_27339_v14 status is now deployed due to DeploymentManager action
chaiml-7b07-69d4-linea_27339_v14 status is now inactive due to system request
chaiml-7b07-69d4-linea_27339_v14 status is now torndown due to DeploymentManager action