chaiml-mega-v1-sonnetwi_86802

developer_uid: zonemercy

submission_id: chaiml-mega-v1-sonnetwi_86802_v1

model_name: chaiml-mega-v1-sonnetwi_86802_v1

model_group: CHaiML/mega-v1-sonnetwin

status: torndown

timestamp: 2026-03-27T04:41:26+00:00

num_battles: 12183

num_wins: 6002

celo_rating: 8485.88

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: basic

model_repo: CHaiML/mega-v1-sonnetwintop2-q35b-lr5e6ep2g8

model_architecture: Qwen3_5MoeForConditionalGeneration

model_num_parameters: 33753909248.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 80

reward_model: default

display_name: chaiml-mega-v1-sonnetwi_86802_v1

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: CHaiML/mega-v1-sonnetwintop2-q35b-lr5e6ep2g8

model_size: 34B

ranking_group: single

us_pacific_date: 2026-03-23

win_ratio: 0.49265369777558893

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|assistant|>', '<|im_end|>', '<|user|>', '####', '</s>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 80}

formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{bot_name}: {message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n{bot_name}:', 'truncate_by_message': True}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-mega-v1-sonnetwi-86802-v1-uploader
Waiting for job on chaiml-mega-v1-sonnetwi-86802-v1-uploader to finish
chaiml-mega-v1-sonnetwi-86802-v1-uploader: Using quantization_mode: none
chaiml-mega-v1-sonnetwi-86802-v1-uploader: Downloading snapshot of CHaiML/mega-v1-sonnetwintop2-q35b-lr5e6ep2g8...
chaiml-mega-v1-sonnetwi-86802-v1-uploader: Downloaded in 37.002s
2026-03-24T02:53:13.091987+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
chaiml-mega-v1-sonnetwi-86802-v1-uploader: Processed model CHaiML/mega-v1-sonnetwintop2-q35b-lr5e6ep2g8 in 62.743s
chaiml-mega-v1-sonnetwi-86802-v1-uploader: creating bucket guanaco-vllm-models
chaiml-mega-v1-sonnetwi-86802-v1-uploader: uploading /dev/shm/model_output to s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/.gitattributes s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/.gitattributes
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/processor_config.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/processor_config.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/README.md s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/README.md
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/generation_config.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/generation_config.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/added_tokens.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/added_tokens.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/special_tokens_map.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/special_tokens_map.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/preprocessor_config.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/preprocessor_config.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/training_args.bin s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/training_args.bin
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/tokenizer_config.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/tokenizer_config.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/merges.txt s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/merges.txt
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/args.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/args.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/config.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/config.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/chat_template.jinja s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/chat_template.jinja
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/vocab.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/vocab.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/trainer_state.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/trainer_state.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/model.safetensors.index.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/model.safetensors.index.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/tokenizer.json s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/tokenizer.json
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/model-00002-of-00002.safetensors s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/model-00002-of-00002.safetensors
2026-03-24T02:54:13.182866+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
chaiml-mega-v1-sonnetwi-86802-v1-uploader: cp /dev/shm/model_output/model-00001-of-00002.safetensors s3://guanaco-vllm-models/chaiml-mega-v1-sonnetwi-86802-v1/default/model-00001-of-00002.safetensors
Job chaiml-mega-v1-sonnetwi-86802-v1-uploader completed after 162.55s with status: succeeded
Stopping job with name chaiml-mega-v1-sonnetwi-86802-v1-uploader
Pipeline stage VLLMUploader completed in 163.13s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 2.67s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-mega-v1-sonnetwi-86802-v1
Waiting for inference service chaiml-mega-v1-sonnetwi-86802-v1 to be ready
2026-03-24T02:55:13.274454+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
2026-03-24T02:56:13.372580+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
2026-03-24T02:57:13.465438+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
2026-03-24T02:58:13.571591+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
Inference service chaiml-mega-v1-sonnetwi-86802-v1 ready after 201.04443621635437s
Pipeline stage VLLMDeployer completed in 201.50s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-24T02:59:13.695755+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.5329110622406006s
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
2026-03-24T03:00:13.857984+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 11.96225881576538s
Received healthy response to inference request in 2.331587553024292s
Received healthy response to inference request in 1.7842798233032227s
2026-03-24T03:01:13.967034+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter-v2.guanaco-backend.kchai-google-us-east4.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.1701200008392334s
Received healthy response to inference request in 1.239673376083374s
Received healthy response to inference request in 1.1622092723846436s
Received healthy response to inference request in 1.2805745601654053s
Received healthy response to inference request in 2.0186331272125244s
Received healthy response to inference request in 1.8115158081054688s
2026-03-24T03:02:14.087138+00:00 monitor updated for chaiml-mega-v1-sonnetwi_86802_v1
Received healthy response to inference request in 3.6181628704071045s
Received healthy response to inference request in 2.562880039215088s
Received healthy response to inference request in 1.4579930305480957s
Received healthy response to inference request in 1.505805253982544s
Received healthy response to inference request in 1.2771821022033691s
Received healthy response to inference request in 1.1277925968170166s
Received healthy response to inference request in 1.1668684482574463s
Received healthy response to inference request in 1.1289739608764648s
Received healthy response to inference request in 1.0333735942840576s
Received healthy response to inference request in 1.2628631591796875s
30 requests
10 failed requests
5th percentile: 1.1283242106437683
10th percentile: 1.1588857412338256
20th percentile: 1.225762701034546
30th percentile: 1.2795568227767944
40th percentile: 1.6728899955749517
50th percentile: 2.175110340118408
60th percentile: 3.567011785507202
70th percentile: 20.121572375297546
80th percentile: 20.138854026794434
90th percentile: 20.144920086860658
95th percentile: 20.155214691162108
99th percentile: 20.301451365947724
mean time: 8.201688106854757
%s, retrying in %s seconds...
Received healthy response to inference request in 1.0591318607330322s
Received healthy response to inference request in 1.076676845550537s
Received healthy response to inference request in 1.250483751296997s
Received healthy response to inference request in 1.129499912261963s
Received healthy response to inference request in 1.0290062427520752s
Received healthy response to inference request in 1.142732858657837s
Received healthy response to inference request in 1.1931805610656738s
Received healthy response to inference request in 1.0517477989196777s
Received healthy response to inference request in 1.1576738357543945s
Received healthy response to inference request in 1.1557283401489258s
Received healthy response to inference request in 1.2380640506744385s
Received healthy response to inference request in 1.189880132675171s
Received healthy response to inference request in 1.1338679790496826s
Received healthy response to inference request in 1.118356466293335s
Received healthy response to inference request in 1.5645923614501953s
Received healthy response to inference request in 1.2769410610198975s
Received healthy response to inference request in 1.1849572658538818s
Received healthy response to inference request in 1.0749247074127197s
Received healthy response to inference request in 1.19081711769104s
Received healthy response to inference request in 1.3296899795532227s
Received healthy response to inference request in 1.2348971366882324s
Received healthy response to inference request in 1.1226797103881836s
Received healthy response to inference request in 1.0672073364257812s
Received healthy response to inference request in 1.0959420204162598s
Received healthy response to inference request in 1.1192429065704346s
Received healthy response to inference request in 1.2511258125305176s
Received healthy response to inference request in 1.1175944805145264s
Received healthy response to inference request in 1.1164085865020752s
Received healthy response to inference request in 1.172334909439087s
Received healthy response to inference request in 1.3222002983093262s
30 requests
0 failed requests
5th percentile: 1.0550706267356873
10th percentile: 1.0663997888565064
20th percentile: 1.0920889854431153
30th percentile: 1.1181278705596924
40th percentile: 1.126771831512451
50th percentile: 1.1492305994033813
60th percentile: 1.1773838520050048
70th percentile: 1.1915261507034303
80th percentile: 1.2405479907989503
90th percentile: 1.2814669847488405
95th percentile: 1.3263196229934693
99th percentile: 1.4964706707000734
mean time: 1.172252877553304
Pipeline stage StressChecker completed in 286.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.44s
Shutdown handler de-registered
chaiml-mega-v1-sonnetwi_86802_v1 status is now deployed due to DeploymentManager action
chaiml-mega-v1-sonnetwi_86802_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-mega-v1-sonnetwi_86802_v1 status is now torndown due to DeploymentManager action