developer_uid: Meliodia
submission_id: chaiml-7b07-69d4-linea_27339_v12
model_name: chaiml-7b07-69d4-linear_27339_v6
model_group: ChaiML/7b07-69d4-linear-
status: torndown
timestamp: 2026-03-27T23:52:11+00:00
num_battles: 11783
num_wins: 5344
celo_rating: 8477.39
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/7b07-69d4-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 24096691200.0
best_of: 6
max_input_tokens: 1440
max_output_tokens: 60
reward_model: default
display_name: chaiml-7b07-69d4-linear_27339_v6
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/7b07-69d4-linear-w01-FP8
model_size: 24B
ranking_group: single
us_pacific_date: 2026-03-24
win_ratio: 0.45353475345837224
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.1, 'frequency_penalty': 0.1, 'stopping_words': ['####', 'You:', '</s>', '\n', '####\n'], 'max_input_tokens': 1440, 'best_of': 6, 'max_output_tokens': 60}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}</s>\n', 'user_template': 'You: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-7b07-69d4-linea-27339-v12-uploader
Waiting for job on chaiml-7b07-69d4-linea-27339-v12-uploader to finish
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-7b07-69d4-linea-27339-v13-uploader
Waiting for job on chaiml-7b07-69d4-linea-27339-v13-uploader to finish
chaiml-7b07-69d4-linea-27339-v12-uploader: Using quantization_mode: fp8
chaiml-7b07-69d4-linea-27339-v12-uploader: Repo ChaiML/7b07-69d4-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-7b07-69d4-linea-27339-v12-uploader: Checking if ChaiML/7b07-69d4-linear-w01-FP8 already exists in ChaiML
chaiml-7b07-69d4-linea-27339-v12-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-7b07-69d4-linea-27339-v12-uploader: Downloading snapshot of ChaiML/7b07-69d4-linear-w01-FP8...
chaiml-7b07-69d4-linea-27339-v12-uploader: Downloaded in 12.396s
chaiml-7b07-69d4-linea-27339-v12-uploader: Processed model ChaiML/7b07-69d4-linear-w01-FP8 in 16.013s
2026-03-24T22:23:34.562609+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v12
Retrying (%r) after connection broken by '%r': %s
Retrying (%r) after connection broken by '%r': %s
chaiml-7b07-69d4-linea-27339-v12-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v12/default/tokenizer.json
chaiml-7b07-69d4-linea-27339-v12-uploader: cp /dev/shm/model_output/model-00006-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v12/default/model-00006-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v12-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v12/default/model-00005-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v12-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v12/default/model-00002-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v12-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v12/default/model-00003-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v12-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v12/default/model-00001-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v12-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v12/default/model-00004-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v13-uploader: Using quantization_mode: fp8
chaiml-7b07-69d4-linea-27339-v13-uploader: Repo ChaiML/7b07-69d4-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-7b07-69d4-linea-27339-v13-uploader: Checking if ChaiML/7b07-69d4-linear-w01-FP8 already exists in ChaiML
chaiml-7b07-69d4-linea-27339-v13-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-7b07-69d4-linea-27339-v13-uploader: Downloading snapshot of ChaiML/7b07-69d4-linear-w01-FP8...
Job chaiml-7b07-69d4-linea-27339-v12-uploader completed after 72.38s with status: succeeded
Stopping job with name chaiml-7b07-69d4-linea-27339-v12-uploader
Pipeline stage VLLMUploader completed in 72.93s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.39s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-7b07-69d4-linea-27339-v12
Waiting for inference service chaiml-7b07-69d4-linea-27339-v12 to be ready
chaiml-7b07-69d4-linea-27339-v13-uploader: Downloaded in 10.277s
chaiml-7b07-69d4-linea-27339-v13-uploader: Processed model ChaiML/7b07-69d4-linear-w01-FP8 in 13.854s
chaiml-7b07-69d4-linea-27339-v13-uploader: creating bucket guanaco-vllm-models
chaiml-7b07-69d4-linea-27339-v13-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v13-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-7b07-69d4-linea-27339-v13-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-7b07-69d4-linea-27339-v13-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-7b07-69d4-linea-27339-v13-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v13-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-7b07-69d4-linea-27339-v13-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v13-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-7b07-69d4-linea-27339-v13-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v13-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-7b07-69d4-linea-27339-v13-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-7b07-69d4-linea-27339-v13-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-7b07-69d4-linea-27339-v13-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-7b07-69d4-linea-27339-v13-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-7b07-69d4-linea-27339-v13-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-7b07-69d4-linea-27339-v13-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-7b07-69d4-linea-27339-v13-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-7b07-69d4-linea-27339-v13-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/.gitattributes
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/tokenizer_config.json
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/README.md
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/recipe.yaml
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/special_tokens_map.json
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/config.json
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/model.safetensors.index.json
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/generation_config.json
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/tokenizer.json
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/model-00005-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/model-00005-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/model-00002-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/model-00002-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/model-00001-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/model-00001-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/model-00003-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/model-00003-of-00006.safetensors
chaiml-7b07-69d4-linea-27339-v13-uploader: cp /dev/shm/model_output/model-00004-of-00006.safetensors s3://guanaco-vllm-models/chaiml-7b07-69d4-linea-27339-v13/default/model-00004-of-00006.safetensors
Job chaiml-7b07-69d4-linea-27339-v13-uploader completed after 54.41s with status: succeeded
Stopping job with name chaiml-7b07-69d4-linea-27339-v13-uploader
Pipeline stage VLLMUploader completed in 55.12s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.40s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-7b07-69d4-linea-27339-v13
Waiting for inference service chaiml-7b07-69d4-linea-27339-v13 to be ready
2026-03-24T22:24:07.440102+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v13
2026-03-24T22:24:34.694983+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v12
2026-03-24T22:25:07.582121+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v13
2026-03-24T22:25:34.837522+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v12
2026-03-24T22:26:07.972125+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v13
Inference service chaiml-7b07-69d4-linea-27339-v12 ready after 160.4867491722107s
Pipeline stage VLLMDeployer completed in 161.22s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5710809230804443s
Inference service chaiml-7b07-69d4-linea-27339-v13 ready after 150.42988538742065s
Pipeline stage VLLMDeployer completed in 151.17s
run pipeline stage %s
Running pipeline stage StressChecker
2026-03-24T22:26:34.978593+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v12
Received healthy response to inference request in 2.5452194213867188s
Received healthy response to inference request in 2.574291706085205s
Received healthy response to inference request in 2.6285881996154785s
Received healthy response to inference request in 5.727345705032349s
Received healthy response to inference request in 2.844651222229004s
Received healthy response to inference request in 2.745307683944702s
Received healthy response to inference request in 2.505460262298584s
Received healthy response to inference request in 2.4501495361328125s
Received healthy response to inference request in 5.628788709640503s
Received healthy response to inference request in 2.513887643814087s
Received healthy response to inference request in 2.566725015640259s
Received healthy response to inference request in 2.4912657737731934s
Received healthy response to inference request in 2.5286738872528076s
Received healthy response to inference request in 5.836455583572388s
Received healthy response to inference request in 2.4976139068603516s
Received healthy response to inference request in 2.544367790222168s
Received healthy response to inference request in 5.720142364501953s
Received healthy response to inference request in 2.5832066535949707s
Received healthy response to inference request in 2.911433219909668s
Received healthy response to inference request in 2.5057272911071777s
2026-03-24T22:27:08.122384+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v13
Received healthy response to inference request in 2.586315393447876s
Received healthy response to inference request in 2.4766457080841064s
Received healthy response to inference request in 2.590599298477173s
Received healthy response to inference request in 2.507390260696411s
Received healthy response to inference request in 2.5175158977508545s
Received healthy response to inference request in 2.6770541667938232s
Received healthy response to inference request in 2.480314254760742s
Received healthy response to inference request in 2.7409331798553467s
Received healthy response to inference request in 2.535149335861206s
Received healthy response to inference request in 2.602630138397217s
Received healthy response to inference request in 2.5116193294525146s
Received healthy response to inference request in 2.6142876148223877s
Received healthy response to inference request in 2.67791748046875s
Received healthy response to inference request in 2.5995681285858154s
Received healthy response to inference request in 2.6368815898895264s
Received healthy response to inference request in 2.7260241508483887s
Received healthy response to inference request in 2.5938549041748047s
Received healthy response to inference request in 2.5972394943237305s
Received healthy response to inference request in 2.567556619644165s
Received healthy response to inference request in 2.6353824138641357s
2026-03-24T22:27:35.234234+00:00 monitor updated for chaiml-7b07-69d4-linea_27339_v12
Received healthy response to inference request in 2.4799444675445557s
Received healthy response to inference request in 2.695908546447754s
Received healthy response to inference request in 2.593515396118164s
Received healthy response to inference request in 2.6847140789031982s
Received healthy response to inference request in 2.514237642288208s
Received healthy response to inference request in 2.6719110012054443s
Received healthy response to inference request in 2.738546133041382s
Received healthy response to inference request in 2.6454946994781494s
Received healthy response to inference request in 2.6914255619049072s
Received healthy response to inference request in 2.6944773197174072s
Received healthy response to inference request in 2.7350635528564453s
30 requests
0 failed requests
5th percentile: 2.4781301498413084
10th percentile: 2.4802772760391236
20th percentile: 2.5038909912109375
30th percentile: 2.5103506088256835
Received healthy response to inference request in 2.9128479957580566s
40th percentile: 2.516204595565796
50th percentile: 2.539758563041687
60th percentile: 2.568966341018677
70th percentile: 2.586299276351929
80th percentile: 2.630246877670288
90th percentile: 2.695789361000061
95th percentile: 2.7369789719581603
99th percentile: 2.8138807463645934
mean time: 2.568058745066325
Pipeline stage StressChecker completed in 83.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.00s
Received healthy response to inference request in 2.5852842330932617s
Shutdown handler de-registered
chaiml-7b07-69d4-linea_27339_v12 status is now deployed due to DeploymentManager action
chaiml-7b07-69d4-linea_27339_v12 status is now inactive due to auto deactivation removed underperforming models
chaiml-7b07-69d4-linea_27339_v12 status is now torndown due to DeploymentManager action