developer_uid: chai_backend_admin
submission_id: function_hofis_2025-12-19
model_name: abtest_kimi
model_group:
status: torndown
timestamp: 2025-12-22T06:01:10+00:00
num_battles: 681908
num_wins: 349897
celo_rating: 1344.59
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: abtest_kimi
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.5131146723604944
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.606477975845337s
Received healthy response to inference request in 2.897815465927124s
Received healthy response to inference request in 3.076578378677368s
Received healthy response to inference request in 3.539440870285034s
Received healthy response to inference request in 3.5805325508117676s
Received healthy response to inference request in 3.7770402431488037s
Received healthy response to inference request in 4.6569740772247314s
Received healthy response to inference request in 2.717627763748169s
Received healthy response to inference request in 3.7785353660583496s
Received healthy response to inference request in 4.964635133743286s
10 requests
0 failed requests
5th percentile: 2.798712229728699
10th percentile: 2.8797966957092287
20th percentile: 3.0408257961273195
30th percentile: 3.400582122802734
40th percentile: 3.564095878601074
50th percentile: 3.6787863969802856
60th percentile: 3.777638292312622
70th percentile: 4.0269181489944454
80th percentile: 4.616577196121216
90th percentile: 4.687740182876587
95th percentile: 4.826187658309936
99th percentile: 4.936945638656616
mean time: 3.7595657825469972
Pipeline stage StressChecker completed in 38.96s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_hofis_2025-12-19 status is now deployed due to DeploymentManager action
function_hofis_2025-12-19 status is now inactive due to auto deactivation removed underperforming models
function_hofis_2025-12-19 status is now torndown due to DeploymentManager action