chaiml-q80b-30k-ep1-sel_67455

developer_uid: chai_backend_admin

submission_id: chaiml-q80b-30k-ep1-sel_67455_v2

model_name: chaiml-q80b-30k-ep1-sel_67455_v2

model_group: ChaiML/Q80B-30K-ep1-self

status: torndown

timestamp: 2025-11-24T23:15:41+00:00

num_battles: 6532

num_wins: 3232

celo_rating: 1294.49

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: basic

model_repo: ChaiML/Q80B-30K-ep1-self-distill-1500

model_architecture: Qwen3NextForCausalLM

model_num_parameters: 2585462784.0

best_of: 8

max_input_tokens: 2048

max_output_tokens: 70

reward_model: default

display_name: chaiml-q80b-30k-ep1-sel_67455_v2

ineligible_reason: max_output_tokens!=64

is_internal_developer: True

language_model: ChaiML/Q80B-30K-ep1-self-distill-1500

model_size: 3B

ranking_group: single

us_pacific_date: 2025-11-24

win_ratio: 0.4947948560930802

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['####', '<|im_end|>'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 70}

formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-q80b-30k-ep1-sel-67455-v2
Waiting for inference service chaiml-q80b-30k-ep1-sel-67455-v2 to be ready
Failed to get response for submission chaiml-q80b-a3b-chai-11_41637_v3: ('http://chaiml-q80b-a3b-chai-11-41637-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/completions', '')
Failed to get response for submission chaiml-q80b-a3b-chai-11_41637_v3: ('http://chaiml-q80b-a3b-chai-11-41637-v3-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/completions', '')
Inference service chaiml-q80b-30k-ep1-sel-67455-v2 ready after 433.5153260231018s
Pipeline stage VLLMDeployer completed in 434.03s
run pipeline stage %s
Running pipeline stage StressChecker
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 2.134701728820801s
Received healthy response to inference request in 2.2612009048461914s
Received healthy response to inference request in 2.33870267868042s
Received healthy response to inference request in 1.308178424835205s
Received healthy response to inference request in 4.992280960083008s
Received healthy response to inference request in 1.2617905139923096s
Received healthy response to inference request in 10.755159378051758s
Received healthy response to inference request in 1.635462999343872s
Received healthy response to inference request in 2.0578527450561523s
Received healthy response to inference request in 1.8329641819000244s
Received healthy response to inference request in 1.7301318645477295s
Failed to get response for submission chaiml-ssnew-v7-1b-dpo-cosine_v2: HTTPConnectionPool(host='chaiml-ssnew-v7-1b-dpo-cosine-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 1.3065733909606934s
Received healthy response to inference request in 1.4549870491027832s
Received healthy response to inference request in 1.1472840309143066s
Received healthy response to inference request in 1.6537365913391113s
Received healthy response to inference request in 1.274249792098999s
Received healthy response to inference request in 1.441960096359253s
Received healthy response to inference request in 1.1949915885925293s
Received healthy response to inference request in 1.3505568504333496s
Received healthy response to inference request in 1.1095116138458252s
Received healthy response to inference request in 1.2635908126831055s
Received healthy response to inference request in 1.437126636505127s
30 requests
8 failed requests
5th percentile: 1.1687524318695068
10th percentile: 1.2551106214523315
20th percentile: 1.3001086711883545
30th percentile: 1.4111557006835938
40th percentile: 1.5632726192474369
50th percentile: 1.781548023223877
60th percentile: 2.1853013992309567
70th percentile: 6.721144485473617
80th percentile: 12.17393093109131
90th percentile: 12.244353795051575
95th percentile: 12.331956338882446
99th percentile: 12.440144591331482
mean time: 4.835160859425863
%s, retrying in %s seconds...
Received healthy response to inference request in 1.5432970523834229s
Received healthy response to inference request in 2.2493317127227783s
Received healthy response to inference request in 1.3229780197143555s
Received healthy response to inference request in 1.2890722751617432s
Received healthy response to inference request in 1.0207927227020264s
Received healthy response to inference request in 1.2430365085601807s
Received healthy response to inference request in 1.3912546634674072s
Received healthy response to inference request in 1.6263294219970703s
Received healthy response to inference request in 1.3412437438964844s
Received healthy response to inference request in 1.3599464893341064s
Received healthy response to inference request in 1.861297369003296s
Received healthy response to inference request in 1.3547873497009277s
Received healthy response to inference request in 1.295018196105957s
Received healthy response to inference request in 1.4246735572814941s
Received healthy response to inference request in 1.1361098289489746s
Received healthy response to inference request in 1.4414005279541016s
Received healthy response to inference request in 1.1905434131622314s
Received healthy response to inference request in 1.4982926845550537s
Received healthy response to inference request in 1.380777359008789s
Received healthy response to inference request in 1.304978847503662s
Received healthy response to inference request in 1.508052110671997s
Received healthy response to inference request in 1.8194797039031982s
Received healthy response to inference request in 1.5434644222259521s
Received healthy response to inference request in 1.4682114124298096s
Received healthy response to inference request in 1.468761920928955s
Received healthy response to inference request in 1.1832902431488037s
Received healthy response to inference request in 1.6106905937194824s
Received healthy response to inference request in 1.5270111560821533s
Received healthy response to inference request in 1.210089921951294s
Received healthy response to inference request in 1.570497751235962s
30 requests
0 failed requests
5th percentile: 1.1573410153388977
10th percentile: 1.1898180961608886
20th percentile: 1.2798651218414308
30th percentile: 1.3175782680511474
40th percentile: 1.357882833480835
50th percentile: 1.4079641103744507
60th percentile: 1.4684316158294677
70th percentile: 1.513739824295044
80th percentile: 1.5488710880279541
90th percentile: 1.6456444501876835
95th percentile: 1.842479419708252
99th percentile: 2.1368017530441286
mean time: 1.4394903659820557
Pipeline stage StressChecker completed in 194.74s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
chaiml-q80b-30k-ep1-sel_67455_v2 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("('http://chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/completions', '')")
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("('http://chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/completions', '')")
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError("('http://chaiml-q80b-30k-ep1-sel-67455-v2-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com/v1/completions', '')")
Shutdown handler de-registered