developer_uid: chai_evaluation_service
submission_id: function_romor_2025-12-17
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-20T18:21:26+00:00
num_battles: 10507
num_wins: 5052
celo_rating: 1280.01
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-20
win_ratio: 0.4808223089368992
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9638416767120361s
Received healthy response to inference request in 2.0816144943237305s
Received healthy response to inference request in 2.1346983909606934s
Received healthy response to inference request in 2.072840929031372s
Received healthy response to inference request in 1.6153240203857422s
Received healthy response to inference request in 1.9303650856018066s
Received healthy response to inference request in 1.984107494354248s
Received healthy response to inference request in 3.344952344894409s
Received healthy response to inference request in 1.7940254211425781s
Received healthy response to inference request in 1.990067720413208s
10 requests
0 failed requests
5th percentile: 1.6957396507263183
10th percentile: 1.7761552810668946
20th percentile: 1.903097152709961
30th percentile: 1.9537986993789673
40th percentile: 1.9760011672973632
50th percentile: 1.987087607383728
60th percentile: 2.0231770038604737
70th percentile: 2.0754729986190794
80th percentile: 2.092231273651123
90th percentile: 2.2557237863540647
95th percentile: 2.800338065624236
99th percentile: 3.236029489040375
mean time: 2.0911837577819825
Pipeline stage StressChecker completed in 22.26s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.58s
Shutdown handler de-registered
function_romor_2025-12-17 status is now deployed due to DeploymentManager action
function_romor_2025-12-17 status is now inactive due to auto deactivation removed underperforming models
function_romor_2025-12-17 status is now torndown due to DeploymentManager action