developer_uid: chai_evaluation_service
submission_id: function_pejir_2025-12-14
model_name: richard
model_group:
status: inactive
timestamp: 2025-12-14T08:56:50+00:00
num_battles: 8263
num_wins: 4048
celo_rating: 1256.37
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-14
win_ratio: 0.48989471136391144
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.4676060676574707s
Received healthy response to inference request in 3.1852822303771973s
Received healthy response to inference request in 2.8637516498565674s
Received healthy response to inference request in 1.8078546524047852s
Received healthy response to inference request in 2.0554559230804443s
Received healthy response to inference request in 2.330327272415161s
Received healthy response to inference request in 3.422792673110962s
Received healthy response to inference request in 1.925114631652832s
Received healthy response to inference request in 2.2291266918182373s
10 requests
1 failed requests
5th percentile: 1.8606216430664062
10th percentile: 1.9133886337280273
20th percentile: 2.029387664794922
30th percentile: 2.1770254611968993
40th percentile: 2.2898470401763915
50th percentile: 2.398966670036316
60th percentile: 2.6260643005371094
70th percentile: 2.9602108240127563
80th percentile: 3.23278431892395
90th percentile: 5.090546679496759
95th percentile: 12.595439708232862
99th percentile: 18.599354131221773
mean time: 4.238764452934265
%s, retrying in %s seconds...
Received healthy response to inference request in 2.104952812194824s
Received healthy response to inference request in 2.5288407802581787s
Received healthy response to inference request in 2.6115434169769287s
Received healthy response to inference request in 2.0675697326660156s
Received healthy response to inference request in 3.140126943588257s
Received healthy response to inference request in 2.5506043434143066s
Received healthy response to inference request in 3.080322265625s
Received healthy response to inference request in 3.169764518737793s
Received healthy response to inference request in 2.379516839981079s
Received healthy response to inference request in 1.8248391151428223s
10 requests
0 failed requests
5th percentile: 1.9340678930282593
10th percentile: 2.0432966709136964
20th percentile: 2.0974761962890627
30th percentile: 2.2971476316452026
40th percentile: 2.469111204147339
50th percentile: 2.5397225618362427
60th percentile: 2.5749799728393556
70th percentile: 2.75217707157135
80th percentile: 3.0922832012176515
90th percentile: 3.1430907011032105
95th percentile: 3.1564276099205015
99th percentile: 3.1670971369743346
mean time: 2.5458080768585205
Pipeline stage StressChecker completed in 70.44s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.14s
Shutdown handler de-registered
function_pejir_2025-12-14 status is now deployed due to DeploymentManager action
function_pejir_2025-12-14 status is now inactive due to auto deactivation removed underperforming models