developer_uid: chai_evaluation_service
submission_id: function_nemit_2025-12-16
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-19T08:21:23+00:00
num_battles: 8512
num_wins: 4215
celo_rating: 1289.81
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-19
win_ratio: 0.4951832706766917
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.602274179458618s
Received healthy response to inference request in 2.3384041786193848s
Received healthy response to inference request in 1.6695621013641357s
Received healthy response to inference request in 2.762753963470459s
Received healthy response to inference request in 1.9761853218078613s
Received healthy response to inference request in 2.231743574142456s
Received healthy response to inference request in 1.8284220695495605s
Received healthy response to inference request in 3.0451242923736572s
Received healthy response to inference request in 2.8602755069732666s
Received healthy response to inference request in 3.1511991024017334s
10 requests
0 failed requests
5th percentile: 1.741049087047577
10th percentile: 1.812536072731018
20th percentile: 1.9466326713562012
30th percentile: 2.1550760984420774
40th percentile: 2.295739936828613
50th percentile: 2.4703391790390015
60th percentile: 2.6664660930633546
70th percentile: 2.7920104265213013
80th percentile: 2.897245264053345
90th percentile: 3.055731773376465
95th percentile: 3.103465437889099
99th percentile: 3.1416523694992065
mean time: 2.4465944290161135
Pipeline stage StressChecker completed in 25.80s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_nemit_2025-12-16 status is now deployed due to DeploymentManager action
function_nemit_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_nemit_2025-12-16 status is now torndown due to DeploymentManager action