developer_uid: Meliodia
submission_id: chaiml-4d70-fd43-linea_51732_v11
model_name: chaiml-4d70-fd43-linear_51732_v5
model_group: ChaiML/4d70-fd43-linear-
status: torndown
timestamp: 2026-04-03T23:42:04+00:00
num_battles: 25598
num_wins: 13213
celo_rating: 1306.84
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: basic
model_repo: ChaiML/4d70-fd43-linear-w01-FP8
model_architecture: MistralForCausalLM
model_num_parameters: 12772070400.0
best_of: 16
max_input_tokens: 1800
max_output_tokens: 74
reward_model: default
display_name: chaiml-4d70-fd43-linear_51732_v5
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/4d70-fd43-linear-w01-FP8
model_size: 13B
ranking_group: single
us_pacific_date: 2026-03-25
win_ratio: 0.5161731385264474
generation_params: {'temperature': 0.85, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.08, 'frequency_penalty': 0.08, 'stopping_words': ['<|im_end|>', '<|im_start|>', '\n', '###', '</s>'], 'max_input_tokens': 1800, 'best_of': 16, 'max_output_tokens': 74}
formatter: {'memory_template': '', 'prompt_template': '', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': True}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-4d70-fd43-linea-51732-v11-uploader
Waiting for job on chaiml-4d70-fd43-linea-51732-v11-uploader to finish
chaiml-4d70-fd43-linea-51732-v11-uploader: Using quantization_mode: fp8
chaiml-4d70-fd43-linea-51732-v11-uploader: Repo ChaiML/4d70-fd43-linear-w01-FP8 already ends in FP8. Skipping...
chaiml-4d70-fd43-linea-51732-v11-uploader: Checking if ChaiML/4d70-fd43-linear-w01-FP8 already exists in ChaiML
chaiml-4d70-fd43-linea-51732-v11-uploader: Model already exists. Downloading to /dev/shm/model_output...
chaiml-4d70-fd43-linea-51732-v11-uploader: Downloading snapshot of ChaiML/4d70-fd43-linear-w01-FP8...
chaiml-4d70-fd43-linea-51732-v11-uploader: Downloaded in 8.226s
chaiml-4d70-fd43-linea-51732-v11-uploader: Processed model ChaiML/4d70-fd43-linear-w01-FP8 in 11.918s
chaiml-4d70-fd43-linea-51732-v11-uploader: creating bucket guanaco-vllm-models
chaiml-4d70-fd43-linea-51732-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:56: SyntaxWarning: invalid escape sequence '\.'
chaiml-4d70-fd43-linea-51732-v11-uploader:   RE_S3_DATESTRING = re.compile('\.[0-9]*(?:[Z\\-\\+]*?)')
chaiml-4d70-fd43-linea-51732-v11-uploader: /usr/lib/python3/dist-packages/S3/BaseUtils.py:57: SyntaxWarning: invalid escape sequence '\s'
chaiml-4d70-fd43-linea-51732-v11-uploader:   RE_XML_NAMESPACE = re.compile(b'^(<?[^>]+?>\s*|\s*)(<\w+) xmlns=[\'"](https?://[^\'"]+)[\'"]', re.MULTILINE)
chaiml-4d70-fd43-linea-51732-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:240: SyntaxWarning: invalid escape sequence '\.'
chaiml-4d70-fd43-linea-51732-v11-uploader:   invalid = re.search("([^a-z0-9\.-])", bucket, re.UNICODE)
chaiml-4d70-fd43-linea-51732-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:244: SyntaxWarning: invalid escape sequence '\.'
chaiml-4d70-fd43-linea-51732-v11-uploader:   invalid = re.search("([^A-Za-z0-9\._-])", bucket, re.UNICODE)
chaiml-4d70-fd43-linea-51732-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:255: SyntaxWarning: invalid escape sequence '\.'
chaiml-4d70-fd43-linea-51732-v11-uploader:   if re.search("-\.", bucket, re.UNICODE):
chaiml-4d70-fd43-linea-51732-v11-uploader: /usr/lib/python3/dist-packages/S3/Utils.py:257: SyntaxWarning: invalid escape sequence '\.'
chaiml-4d70-fd43-linea-51732-v11-uploader:   if re.search("\.\.", bucket, re.UNICODE):
chaiml-4d70-fd43-linea-51732-v11-uploader: /usr/lib/python3/dist-packages/S3/S3Uri.py:155: SyntaxWarning: invalid escape sequence '\w'
chaiml-4d70-fd43-linea-51732-v11-uploader:   _re = re.compile("^(\w+://)?(.*)", re.UNICODE)
chaiml-4d70-fd43-linea-51732-v11-uploader: /usr/lib/python3/dist-packages/S3/FileLists.py:480: SyntaxWarning: invalid escape sequence '\*'
chaiml-4d70-fd43-linea-51732-v11-uploader:   wildcard_split_result = re.split("\*|\?", uri_str, maxsplit=1)
chaiml-4d70-fd43-linea-51732-v11-uploader: Bucket 's3://guanaco-vllm-models/' created
chaiml-4d70-fd43-linea-51732-v11-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/README.md
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/model.safetensors.index.json
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/recipe.yaml s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/recipe.yaml
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/chat_template.jinja
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/.gitattributes
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/tokenizer_config.json
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/generation_config.json
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/config.json
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/special_tokens_map.json
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/tokenizer.json
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/model-00001-of-00003.safetensors s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/model-00001-of-00003.safetensors
chaiml-4d70-fd43-linea-51732-v11-uploader: cp /dev/shm/model_output/model-00002-of-00003.safetensors s3://guanaco-vllm-models/chaiml-4d70-fd43-linea-51732-v11/default/model-00002-of-00003.safetensors
Job chaiml-4d70-fd43-linea-51732-v11-uploader completed after 42.34s with status: succeeded
Stopping job with name chaiml-4d70-fd43-linea-51732-v11-uploader
Pipeline stage VLLMUploader completed in 42.79s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.43s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-4d70-fd43-linea-51732-v11
Waiting for inference service chaiml-4d70-fd43-linea-51732-v11 to be ready
2026-03-25T22:19:47.908881+00:00 monitor updated for chaiml-4d70-fd43-linea_51732_v11
2026-03-25T22:20:47.998076+00:00 monitor updated for chaiml-4d70-fd43-linea_51732_v11
2026-03-25T22:21:48.097035+00:00 monitor updated for chaiml-4d70-fd43-linea_51732_v11
Failed to get response for submission chaiml-gspo-glm47-cas72_57867_v2: ('http://chaiml-gspo-glm47-cas72-57867-v2-predictor.tenant-chaiml-guanaco.k2.chaiverse.com/v1/completions', 'activator request timeout')
Inference service chaiml-4d70-fd43-linea-51732-v11 ready after 170.4482297897339s
Pipeline stage VLLMDeployer completed in 170.98s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.088171482086182s
Received healthy response to inference request in 5.271894216537476s
Received healthy response to inference request in 5.142602920532227s
Received healthy response to inference request in 1.9979667663574219s
Received healthy response to inference request in 2.0094454288482666s
2026-03-25T22:22:48.196703+00:00 monitor updated for chaiml-4d70-fd43-linea_51732_v11
Received healthy response to inference request in 5.057027101516724s
Received healthy response to inference request in 2.099447727203369s
Received healthy response to inference request in 2.129443883895874s
Received healthy response to inference request in 5.054140090942383s
Received healthy response to inference request in 1.9399971961975098s
Received healthy response to inference request in 2.222066640853882s
Received healthy response to inference request in 2.5568971633911133s
Received healthy response to inference request in 1.9730682373046875s
Received healthy response to inference request in 2.0415806770324707s
Received healthy response to inference request in 1.925593376159668s
Received healthy response to inference request in 2.1057381629943848s
Received healthy response to inference request in 2.689345121383667s
Received healthy response to inference request in 1.9789247512817383s
Received healthy response to inference request in 1.9896430969238281s
Received healthy response to inference request in 1.9713311195373535s
Received healthy response to inference request in 1.9234671592712402s
Received healthy response to inference request in 2.278764486312866s
Received healthy response to inference request in 2.1168816089630127s
Received healthy response to inference request in 2.253448247909546s
Received healthy response to inference request in 1.9852995872497559s
Received healthy response to inference request in 2.032153606414795s
Received healthy response to inference request in 1.990567684173584s
Received healthy response to inference request in 2.211183786392212s
Received healthy response to inference request in 2.0934293270111084s
Received healthy response to inference request in 2.381247043609619s
30 requests
0 failed requests
5th percentile: 1.9320750951766967
10th percentile: 1.968197727203369
20th percentile: 1.9840246200561524
30th percentile: 1.9957470417022705
40th percentile: 2.0378098487854004
50th percentile: 2.102592945098877
60th percentile: 2.162139844894409
70th percentile: 2.261043119430542
80th percentile: 2.5833867549896246
90th percentile: 5.060141539573669
95th percentile: 5.118108773231506
99th percentile: 5.234399740695953
mean time: 2.617025589942932
Pipeline stage StressChecker completed in 81.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.76s
Shutdown handler de-registered
chaiml-4d70-fd43-linea_51732_v11 status is now deployed due to DeploymentManager action
chaiml-4d70-fd43-linea_51732_v11 status is now inactive due to system request
chaiml-4d70-fd43-linea_51732_v11 status is now torndown due to DeploymentManager action