developer_uid: chai_evaluation_service
submission_id: function_muten_2025-12-18
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-21T10:21:19+00:00
num_battles: 8180
num_wins: 4051
celo_rating: 1289.95
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.49523227383863083
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9413280487060547s
Received healthy response to inference request in 2.041553497314453s
Received healthy response to inference request in 2.181333303451538s
Received healthy response to inference request in 1.9255754947662354s
Received healthy response to inference request in 3.1088950634002686s
Received healthy response to inference request in 2.429363250732422s
Received healthy response to inference request in 3.2141315937042236s
Received healthy response to inference request in 2.51466965675354s
Received healthy response to inference request in 1.9916844367980957s
Received healthy response to inference request in 2.029808521270752s
10 requests
0 failed requests
5th percentile: 1.932664144039154
10th percentile: 1.9397527933120728
20th percentile: 1.9816131591796875
30th percentile: 2.0183712959289553
40th percentile: 2.0368555068969725
50th percentile: 2.1114434003829956
60th percentile: 2.2805452823638914
70th percentile: 2.4549551725387575
80th percentile: 2.633514738082886
90th percentile: 3.119418716430664
95th percentile: 3.1667751550674437
99th percentile: 3.204660305976868
mean time: 2.337834286689758
Pipeline stage StressChecker completed in 24.69s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.73s
Shutdown handler de-registered
function_muten_2025-12-18 status is now deployed due to DeploymentManager action
function_muten_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_muten_2025-12-18 status is now torndown due to DeploymentManager action