developer_uid: chai_backend_admin
submission_id: function_kasuf_2025-12-19
model_name: abtest_kimi
model_group:
status: torndown
timestamp: 2025-12-22T05:21:19+00:00
num_battles: 6401
num_wins: 3467
celo_rating: 1322.28
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest_kimi
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.5416341196688017
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.315199136734009s
Received healthy response to inference request in 3.7448935508728027s
Received healthy response to inference request in 3.0574591159820557s
Received healthy response to inference request in 2.5619568824768066s
Received healthy response to inference request in 2.5728559494018555s
Received healthy response to inference request in 2.1638128757476807s
Received healthy response to inference request in 2.6992666721343994s
Received healthy response to inference request in 3.4499409198760986s
Received healthy response to inference request in 1.949352741241455s
Received healthy response to inference request in 2.6901941299438477s
10 requests
0 failed requests
5th percentile: 2.0458598017692564
10th percentile: 2.142366862297058
20th percentile: 2.4823280811309814
30th percentile: 2.569586229324341
40th percentile: 2.6432588577270506
50th percentile: 2.6947304010391235
60th percentile: 2.8425436496734617
70th percentile: 3.1752036571502686
80th percentile: 3.5089314460754397
90th percentile: 3.8019241094589233
95th percentile: 4.058561623096465
99th percentile: 4.263871634006501
mean time: 2.9204931974411013
Pipeline stage StressChecker completed in 31.36s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_kasuf_2025-12-19 status is now deployed due to DeploymentManager action
function_kasuf_2025-12-19 status is now inactive due to auto deactivation removed underperforming models
function_kasuf_2025-12-19 status is now torndown due to DeploymentManager action