chaiml-q80b-30k-ep1-sel_53713

developer_uid: chai_backend_admin

submission_id: chaiml-q80b-30k-ep1-sel_53713_v3

model_name: chaiml-q80b-30k-ep1-sel_53713_v3

model_group: ChaiML/Q80B-30K-ep1-self

status: torndown

timestamp: 2025-11-24T21:18:01+00:00

num_battles: 9137

num_wins: 4475

celo_rating: 1292.97

family_friendly_score: 0.498

family_friendly_standard_error: 0.0070710112430967045

submission_type: basic

model_repo: ChaiML/Q80B-30K-ep1-self-distill

model_architecture: Qwen3NextForCausalLM

model_num_parameters: 2585462784.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 70

reward_model: default

display_name: chaiml-q80b-30k-ep1-sel_53713_v3

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: ChaiML/Q80B-30K-ep1-self-distill

model_size: 3B

ranking_group: single

us_pacific_date: 2025-11-24

win_ratio: 0.48976688190872275

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 70}

formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.15s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-q80b-30k-ep1-sel-53713-v3
Waiting for inference service chaiml-q80b-30k-ep1-sel-53713-v3 to be ready
Inference service chaiml-q80b-30k-ep1-sel-53713-v3 ready after 523.5749802589417s
Pipeline stage VLLMDeployer completed in 524.22s
run pipeline stage %s
Running pipeline stage StressChecker
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 13.24289321899414s
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 1.8991594314575195s
Received healthy response to inference request in 1.1794862747192383s
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 1.2128944396972656s
Received healthy response to inference request in 1.184391736984253s
Received healthy response to inference request in 1.3018932342529297s
Received healthy response to inference request in 1.2673749923706055s
Received healthy response to inference request in 1.3944530487060547s
Received healthy response to inference request in 1.5533695220947266s
Received healthy response to inference request in 1.59609055519104s
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 1.4628686904907227s
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 1.4232900142669678s
Received healthy response to inference request in 1.1929497718811035s
Received healthy response to inference request in 2.3051021099090576s
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 1.2334749698638916s
Received healthy response to inference request in 1.270357370376587s
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 1.370168924331665s
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-53713-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
30 requests
13 failed requests
5th percentile: 1.1882428526878357
10th percentile: 1.2108999729156493
20th percentile: 1.2697608947753907
30th percentile: 1.3871678113937378
40th percentile: 1.5171691894531252
50th percentile: 2.1021307706832886
60th percentile: 12.175820589065552
70th percentile: 12.19181249141693
80th percentile: 12.239961385726929
90th percentile: 12.47685992717743
95th percentile: 12.763480460643768
99th percentile: 13.12056322813034
mean time: 6.540754183133443
%s, retrying in %s seconds...
Received healthy response to inference request in 1.4016754627227783s
Received healthy response to inference request in 2.2920353412628174s
Received healthy response to inference request in 12.572985172271729s
Received healthy response to inference request in 1.3481674194335938s
Received healthy response to inference request in 1.2131133079528809s
Received healthy response to inference request in 1.3223819732666016s
Received healthy response to inference request in 1.7388453483581543s
Received healthy response to inference request in 1.209223985671997s
Received healthy response to inference request in 1.1827478408813477s
Received healthy response to inference request in 1.211148738861084s
Received healthy response to inference request in 1.515458345413208s
Received healthy response to inference request in 1.2491331100463867s
Received healthy response to inference request in 1.8160851001739502s
Received healthy response to inference request in 1.1912147998809814s
Received healthy response to inference request in 1.3926048278808594s
Received healthy response to inference request in 1.81730318069458s
Received healthy response to inference request in 1.6292610168457031s
Received healthy response to inference request in 1.5533971786499023s
Received healthy response to inference request in 1.2731742858886719s
Received healthy response to inference request in 1.3603579998016357s
Received healthy response to inference request in 1.5102388858795166s
Received healthy response to inference request in 1.4745776653289795s
Received healthy response to inference request in 1.1851904392242432s
Received healthy response to inference request in 1.4925322532653809s
Received healthy response to inference request in 1.9593188762664795s
Received healthy response to inference request in 1.591942548751831s
Received healthy response to inference request in 1.2732431888580322s
Received healthy response to inference request in 1.1179778575897217s
Received healthy response to inference request in 1.7385444641113281s
Received healthy response to inference request in 1.4968910217285156s
30 requests
0 failed requests
5th percentile: 1.1838470101356506
10th percentile: 1.1906123638153077
20th percentile: 1.2127203941345215
30th percentile: 1.273222517967224
40th percentile: 1.3554817676544189
50th percentile: 1.438126564025879
60th percentile: 1.502230167388916
70th percentile: 1.564960789680481
80th percentile: 1.7386046409606934
90th percentile: 1.8315047502517703
95th percentile: 2.1423129320144643
99th percentile: 9.591509721279152
mean time: 1.837692387898763
Pipeline stage StressChecker completed in 256.44s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.68s
Shutdown handler de-registered
chaiml-q80b-30k-ep1-sel_53713_v3 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 1971.46s
Shutdown handler de-registered
chaiml-q80b-30k-ep1-sel_53713_v3 status is now inactive due to auto deactivation removed underperforming models
chaiml-q80b-30k-ep1-sel_53713_v3 status is now torndown due to DeploymentManager action