developer_uid: chai_backend_admin
submission_id: chaiml-q80a3b-nobotname_30620_v1
model_name: chaiml-q80a3b-nobotname_30620_v1
model_group: ChaiML/Q80A3B-NoBotName-
status: protected
timestamp: 2025-11-25T00:21:45+00:00
num_battles: 9450
num_wins: 4750
celo_rating: 1293.31
family_friendly_score: 0.5016
family_friendly_standard_error: 0.007071031607905596
submission_type: basic
model_repo: ChaiML/Q80A3B-NoBotName-AutoReg-LP-Mix-In-EP2
model_architecture: Qwen3NextForCausalLM
model_num_parameters: 2585462784.0
best_of: 8
max_input_tokens: 2048
max_output_tokens: 70
reward_model: default
display_name: chaiml-q80a3b-nobotname_30620_v1
ineligible_reason: max_output_tokens!=64
is_internal_developer: True
language_model: ChaiML/Q80A3B-NoBotName-AutoReg-LP-Mix-In-EP2
model_size: 3B
ranking_group: single
us_pacific_date: 2025-11-24
win_ratio: 0.5026455026455027
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|im_end|>', '####'], 'max_input_tokens': 2048, 'best_of': 8, 'max_output_tokens': 70}
formatter: {'memory_template': "<|im_start|>system\n{bot_name}'s persona: {memory}<|im_end|>\n", 'prompt_template': '', 'bot_template': '<|im_start|>assistant\n{message}<|im_end|>\n', 'user_template': '<|im_start|>user\n{message}<|im_end|>\n', 'response_template': '<|im_start|>assistant\n', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMTemplater
Pipeline stage VLLMTemplater completed in 0.14s
run pipeline stage %s
Running pipeline stage VLLMDeployer
Creating inference service chaiml-q80a3b-nobotname-30620-v1
Waiting for inference service chaiml-q80a3b-nobotname-30620-v1 to be ready
Failed to get response for submission blend_fajar_2025-11-05: ('http://guanaco-model-mesh-load-balancer.model-mesh.k2.chaiverse.com/models/chaiml-csfs-v3-3-dpo-lr_86358_v2/predict', '{"detail":"1 validation error for RuntimeResponse\\npredictions\\n  Field required [type=missing, input_value={\'detail\': \\"503, message=...o-lr_86358_v2/predict\'\\"}, input_type=dict]\\n    For further information visit https://errors.pydantic.dev/2.11/v/missing"}')
Failed to get response for submission chaiml-ca18-v1-2-dpo-cosine_v4: HTTPConnectionPool(host='chaiml-ca18-v1-2-dpo-cosine-v4-predictor.tenant-chaiml-guanaco.kchai-coreweave-us-east-04a.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Inference service chaiml-q80a3b-nobotname-30620-v1 ready after 510.2738130092621s
Pipeline stage VLLMDeployer completed in 510.65s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 2.6538736820220947s
Received healthy response to inference request in 2.6715714931488037s
Received healthy response to inference request in 2.1496775150299072s
Received healthy response to inference request in 1.1838374137878418s
Received healthy response to inference request in 1.1536650657653809s
Received healthy response to inference request in 0.9733164310455322s
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 1.111898422241211s
{"detail":"HTTPConnectionPool(host='chaiml-q80a3b-nobotname-30620-v1-predictor.tenant-chaiml-guanaco.k2.chaiverse.com', port=80): Read timed out. (read timeout=12.0)"}
Received unhealthy response to inference request!
Received healthy response to inference request in 2.2376549243927s
Received healthy response to inference request in 1.3501503467559814s
Received healthy response to inference request in 10.616634845733643s
Received healthy response to inference request in 1.5707826614379883s
Received healthy response to inference request in 1.7948241233825684s
Received healthy response to inference request in 1.2564468383789062s
Received healthy response to inference request in 3.102532148361206s
Received healthy response to inference request in 1.1346395015716553s
Received healthy response to inference request in 1.2771601676940918s
Received healthy response to inference request in 1.352599859237671s
Received healthy response to inference request in 1.7544527053833008s
Received healthy response to inference request in 1.3102598190307617s
30 requests
11 failed requests
5th percentile: 1.1221319079399108
10th percentile: 1.1517625093460082
20th percentile: 1.2730175018310548
30th percentile: 1.351865005493164
40th percentile: 1.7786755561828613
50th percentile: 2.4457643032073975
60th percentile: 6.10817322731017
70th percentile: 12.159409379959106
80th percentile: 12.164853239059449
90th percentile: 12.167764854431152
95th percentile: 12.201939523220062
99th percentile: 17.827156357765205
mean time: 6.0824260950088505
%s, retrying in %s seconds...
Received healthy response to inference request in 1.9251177310943604s
Received healthy response to inference request in 1.7057020664215088s
Received healthy response to inference request in 1.5090172290802002s
Received healthy response to inference request in 1.319718360900879s
Received healthy response to inference request in 0.9631211757659912s
Received healthy response to inference request in 1.0565452575683594s
Received healthy response to inference request in 1.6816184520721436s
Received healthy response to inference request in 1.1509103775024414s
Received healthy response to inference request in 1.4294559955596924s
Received healthy response to inference request in 1.1364753246307373s
Received healthy response to inference request in 1.9401414394378662s
Received healthy response to inference request in 1.293219804763794s
Received healthy response to inference request in 0.9674158096313477s
Received healthy response to inference request in 1.9012160301208496s
Received healthy response to inference request in 1.4575169086456299s
Received healthy response to inference request in 1.520869493484497s
Received healthy response to inference request in 1.1673274040222168s
Received healthy response to inference request in 1.1459455490112305s
Received healthy response to inference request in 1.3974277973175049s
Received healthy response to inference request in 1.1679954528808594s
Received healthy response to inference request in 1.4052810668945312s
Received healthy response to inference request in 1.4460992813110352s
Received healthy response to inference request in 1.1195244789123535s
Received healthy response to inference request in 1.3097922801971436s
Received healthy response to inference request in 1.448056697845459s
Received healthy response to inference request in 1.1421856880187988s
Received healthy response to inference request in 1.3854570388793945s
Received healthy response to inference request in 1.243962049484253s
Received healthy response to inference request in 1.1202659606933594s
Received healthy response to inference request in 1.1317222118377686s
30 requests
0 failed requests
5th percentile: 1.007524061203003
10th percentile: 1.113226556777954
20th percentile: 1.1355247020721435
30th percentile: 1.149420928955078
40th percentile: 1.2135754108428956
50th percentile: 1.3147553205490112
60th percentile: 1.4005691051483153
70th percentile: 1.4466865062713623
80th percentile: 1.5113876819610597
90th percentile: 1.725253462791443
95th percentile: 1.9143619656562805
99th percentile: 1.9357845640182496
mean time: 1.3529701471328734
Pipeline stage StressChecker completed in 228.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
chaiml-q80a3b-nobotname_30620_v1 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2369.43s
Shutdown handler de-registered
chaiml-q80a3b-nobotname_30620_v1 status is now protected due to ABTestQueueItem
chaiml-q80a3b-nobotname_30620_v1 status is now protected due to ABTestQueueItem
chaiml-q80a3b-nobotname_30620_v1 status is now protected due to ABTestQueueItem