developer_uid: chai_evaluation_service
submission_id: function_mebek_2025-12-14
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-17T17:41:32+00:00
num_battles: 8639
num_wins: 4364
celo_rating: 1256.41
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-14
win_ratio: 0.5051510591503646
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8730251789093018s
Received healthy response to inference request in 1.7393667697906494s
Received healthy response to inference request in 3.7054102420806885s
Received healthy response to inference request in 4.177444219589233s
Received healthy response to inference request in 3.2816314697265625s
Received healthy response to inference request in 7.176966190338135s
Received healthy response to inference request in 3.4967753887176514s
Received healthy response to inference request in 3.3301048278808594s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.9867806434631348s
Received healthy response to inference request in 2.8319895267486572s
10 requests
0 failed requests
5th percentile: 2.231047010421753
10th percentile: 2.7227272510528566
20th percentile: 2.864818048477173
30th percentile: 2.952654004096985
40th percentile: 3.1636911392211915
50th percentile: 3.305868148803711
60th percentile: 3.396773052215576
70th percentile: 3.5593658447265626
80th percentile: 3.7998170375823976
90th percentile: 4.4773964166641225
95th percentile: 5.827181303501126
99th percentile: 6.907009212970734
mean time: 3.559949445724487
Pipeline stage StressChecker completed in 36.91s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.56s
Shutdown handler de-registered
function_mebek_2025-12-14 status is now deployed due to DeploymentManager action
function_mebek_2025-12-14 status is now inactive due to auto deactivation removed underperforming models
function_mebek_2025-12-14 status is now torndown due to DeploymentManager action