developer_uid: chai_evaluation_service
submission_id: function_nilas_2025-12-18
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-21T01:01:07+00:00
num_battles: 7563
num_wins: 3851
celo_rating: 1299.83
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-20
win_ratio: 0.5091894750760281
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.1708498001098633s
Received healthy response to inference request in 3.151808977127075s
Received healthy response to inference request in 3.367617607116699s
Received healthy response to inference request in 2.2632179260253906s
Received healthy response to inference request in 3.286444902420044s
Received healthy response to inference request in 3.423267364501953s
Received healthy response to inference request in 2.254805326461792s
Received healthy response to inference request in 2.940650224685669s
Received healthy response to inference request in 1.7177095413208008s
Received healthy response to inference request in 2.1292901039123535s
10 requests
0 failed requests
5th percentile: 1.9029207944869995
10th percentile: 2.088132047653198
20th percentile: 2.162537860870361
30th percentile: 2.2296186685562134
40th percentile: 2.259852886199951
50th percentile: 2.60193407535553
60th percentile: 3.0251137256622314
70th percentile: 3.1921997547149656
80th percentile: 3.302679443359375
90th percentile: 3.3731825828552244
95th percentile: 3.398224973678589
99th percentile: 3.4182588863372803
mean time: 2.670566177368164
Pipeline stage StressChecker completed in 27.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.63s
Shutdown handler de-registered
function_nilas_2025-12-18 status is now deployed due to DeploymentManager action
function_nilas_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_nilas_2025-12-18 status is now torndown due to DeploymentManager action