developer_uid: chai_backend_admin
submission_id: function_depar_2025-11-19
model_name: function_depar_2025-11-19
model_group:
status: torndown
timestamp: 2025-11-23T00:31:05+00:00
num_battles: 5227
num_wins: 2828
celo_rating: 1321.78
family_friendly_score: 0.5688
family_friendly_standard_error: 0.00700380696478708
submission_type: function
display_name: function_depar_2025-11-19
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-11-19
win_ratio: 0.5410369236655825
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.6209783554077148s
Received healthy response to inference request in 2.285322427749634s
5 requests
3 failed requests
5th percentile: 1.7538471698760987
10th percentile: 1.8867159843444825
20th percentile: 2.15245361328125
30th percentile: 5.857023286819457
40th percentile: 13.000425004959109
50th percentile: 20.143826723098755
60th percentile: 20.18338837623596
70th percentile: 20.22295002937317
80th percentile: 20.254736042022706
90th percentile: 20.27874641418457
95th percentile: 20.2907516002655
99th percentile: 20.300355749130247
mean time: 12.919123029708862
%s, retrying in %s seconds...
Received healthy response to inference request in 1.419161319732666s
Received healthy response to inference request in 9.062610149383545s
Received healthy response to inference request in 1.6303093433380127s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.653571367263794s
5 requests
1 failed requests
5th percentile: 1.4613909244537353
10th percentile: 1.5036205291748046
20th percentile: 1.5880797386169434
30th percentile: 1.6349617481231689
40th percentile: 1.6442665576934814
50th percentile: 1.653571367263794
60th percentile: 4.617186880111694
70th percentile: 7.580802392959593
80th percentile: 11.27338151931763
90th percentile: 15.694924259185793
95th percentile: 17.905695629119872
99th percentile: 19.67431272506714
mean time: 6.776423835754395
%s, retrying in %s seconds...
Received healthy response to inference request in 2.549854278564453s
Received healthy response to inference request in 2.34452748298645s
Received healthy response to inference request in 2.0976600646972656s
Received healthy response to inference request in 1.891282081604004s
Received healthy response to inference request in 1.579801082611084s
5 requests
0 failed requests
5th percentile: 1.642097282409668
10th percentile: 1.704393482208252
20th percentile: 1.8289858818054199
30th percentile: 1.9325576782226563
40th percentile: 2.0151088714599608
50th percentile: 2.0976600646972656
60th percentile: 2.1964070320129396
70th percentile: 2.295153999328613
80th percentile: 2.3855928421020507
90th percentile: 2.467723560333252
95th percentile: 2.5087889194488526
99th percentile: 2.541641206741333
mean time: 2.0926249980926515
Pipeline stage StressChecker completed in 112.54s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_depar_2025-11-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 1838.86s
Shutdown handler de-registered
function_depar_2025-11-19 status is now inactive due to auto deactivation removed underperforming models
function_depar_2025-11-19 status is now torndown due to DeploymentManager action