developer_uid: chai_evaluation_service
submission_id: function_soret_2025-12-18
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-21T22:31:16+00:00
num_battles: 6620
num_wins: 3246
celo_rating: 1286.36
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.49033232628398793
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.4921648502349854s
Received healthy response to inference request in 2.924672842025757s
Received healthy response to inference request in 2.246385335922241s
Received healthy response to inference request in 2.922320604324341s
Received healthy response to inference request in 2.0177316665649414s
Received healthy response to inference request in 2.4194135665893555s
Received healthy response to inference request in 2.607272148132324s
Received healthy response to inference request in 2.191135883331299s
Received healthy response to inference request in 2.4569191932678223s
Received healthy response to inference request in 2.4240715503692627s
10 requests
0 failed requests
5th percentile: 2.0957635641098022
10th percentile: 2.173795461654663
20th percentile: 2.235335445404053
30th percentile: 2.367505097389221
40th percentile: 2.4222083568572996
50th percentile: 2.4404953718185425
60th percentile: 2.517060375213623
70th percentile: 2.701786684989929
80th percentile: 2.922791051864624
90th percentile: 2.9814220428466793
95th percentile: 3.236793446540832
99th percentile: 3.4410905694961547
mean time: 2.570208764076233
Pipeline stage StressChecker completed in 27.19s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_soret_2025-12-18 status is now deployed due to DeploymentManager action
function_soret_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_soret_2025-12-18 status is now torndown due to DeploymentManager action