developer_uid: chai_evaluation_service
submission_id: function_nusob_2025-12-17
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-20T20:51:15+00:00
num_battles: 8416
num_wins: 4160
celo_rating: 1289.28
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-20
win_ratio: 0.49429657794676807
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9833879470825195s
Received healthy response to inference request in 2.3064122200012207s
Received healthy response to inference request in 2.3373303413391113s
Received healthy response to inference request in 2.7129554748535156s
Received healthy response to inference request in 2.4765539169311523s
Received healthy response to inference request in 2.301149368286133s
Received healthy response to inference request in 2.4325783252716064s
Received healthy response to inference request in 3.039663076400757s
Received healthy response to inference request in 1.7736728191375732s
Received healthy response to inference request in 2.325137138366699s
10 requests
0 failed requests
5th percentile: 1.868044626712799
10th percentile: 1.9624164342880248
20th percentile: 2.2375970840454102
30th percentile: 2.3048333644866945
40th percentile: 2.317647171020508
50th percentile: 2.3312337398529053
60th percentile: 2.3754295349121093
70th percentile: 2.44577100276947
80th percentile: 2.523834228515625
90th percentile: 2.7456262350082397
95th percentile: 2.892644655704498
99th percentile: 3.010259392261505
mean time: 2.368884062767029
Pipeline stage StressChecker completed in 25.03s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
function_nusob_2025-12-17 status is now deployed due to DeploymentManager action
function_nusob_2025-12-17 status is now inactive due to auto deactivation removed underperforming models
function_nusob_2025-12-17 status is now torndown due to DeploymentManager action