developer_uid: chai_evaluation_service
submission_id: function_pilem_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T16:51:15+00:00
num_battles: 6687
num_wins: 3213
celo_rating: 1256.56
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-15
win_ratio: 0.48048452220726784
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.483259916305542s
Received healthy response to inference request in 3.1174774169921875s
Received healthy response to inference request in 1.9854581356048584s
Received healthy response to inference request in 2.209350109100342s
Received healthy response to inference request in 2.042448043823242s
Received healthy response to inference request in 2.972416877746582s
Received healthy response to inference request in 2.657632350921631s
Received healthy response to inference request in 2.277059316635132s
Received healthy response to inference request in 3.127979040145874s
Received healthy response to inference request in 2.1233279705047607s
10 requests
0 failed requests
5th percentile: 2.011103594303131
10th percentile: 2.0367490530014036
20th percentile: 2.107151985168457
30th percentile: 2.1835434675216674
40th percentile: 2.249975633621216
50th percentile: 2.380159616470337
60th percentile: 2.5530088901519776
70th percentile: 2.752067708969116
80th percentile: 3.001428985595703
90th percentile: 3.118527579307556
95th percentile: 3.123253309726715
99th percentile: 3.127033894062042
mean time: 2.4996409177780152
Pipeline stage StressChecker completed in 26.39s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.89s
Shutdown handler de-registered
function_pilem_2025-12-15 status is now deployed due to DeploymentManager action
function_pilem_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_pilem_2025-12-15 status is now torndown due to DeploymentManager action