developer_uid: chai_evaluation_service
submission_id: function_lilit_2025-12-14
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-17T23:41:17+00:00
num_battles: 8653
num_wins: 4336
celo_rating: 1256.42
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-14
win_ratio: 0.5010978851265457
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.588078498840332s
Received healthy response to inference request in 2.931065797805786s
Received healthy response to inference request in 2.315645694732666s
Received healthy response to inference request in 2.392934560775757s
Received healthy response to inference request in 2.486353635787964s
Received healthy response to inference request in 2.7866575717926025s
Received healthy response to inference request in 1.8162822723388672s
Received healthy response to inference request in 2.422194004058838s
Received healthy response to inference request in 4.0664262771606445s
Received healthy response to inference request in 3.7328248023986816s
10 requests
0 failed requests
5th percentile: 2.0409958124160767
10th percentile: 2.2657093524932863
20th percentile: 2.3774767875671388
30th percentile: 2.4134161710739135
40th percentile: 2.4606897830963135
50th percentile: 2.636505603790283
60th percentile: 2.8444208621978757
70th percentile: 3.1281696081161496
80th percentile: 3.617027759552002
90th percentile: 3.766184949874878
95th percentile: 3.916305613517761
99th percentile: 4.036402144432068
mean time: 2.853846311569214
Pipeline stage StressChecker completed in 29.89s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.85s
Shutdown handler de-registered
function_lilit_2025-12-14 status is now deployed due to DeploymentManager action
function_lilit_2025-12-14 status is now inactive due to auto deactivation removed underperforming models
function_lilit_2025-12-14 status is now torndown due to DeploymentManager action