developer_uid: chai_evaluation_service
submission_id: function_nagis_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T20:51:15+00:00
num_battles: 11443
num_wins: 5595
celo_rating: 1285.39
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.4889452066765708
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.4969217777252197s
Received healthy response to inference request in 3.4487221240997314s
Received healthy response to inference request in 3.141000270843506s
Received healthy response to inference request in 2.5483322143554688s
Received healthy response to inference request in 2.6363942623138428s
Received healthy response to inference request in 5.109203815460205s
Received healthy response to inference request in 2.8630290031433105s
Received healthy response to inference request in 3.098875045776367s
Received healthy response to inference request in 2.5295522212982178s
10 requests
1 failed requests
5th percentile: 2.511605477333069
10th percentile: 2.526289176940918
20th percentile: 2.5445762157440184
30th percentile: 2.6099756479263307
40th percentile: 2.7723751068115234
50th percentile: 2.980952024459839
60th percentile: 3.1157251358032227
70th percentile: 3.2333168268203734
80th percentile: 3.7808184623718266
90th percentile: 6.612546682357783
95th percentile: 13.377589583396896
99th percentile: 18.78962390422821
mean time: 4.80146632194519
%s, retrying in %s seconds...
Received healthy response to inference request in 4.726875066757202s
Received healthy response to inference request in 2.615584135055542s
Received healthy response to inference request in 3.6496877670288086s
Received healthy response to inference request in 4.2835893630981445s
Received healthy response to inference request in 3.8931267261505127s
Received healthy response to inference request in 3.3075809478759766s
Received healthy response to inference request in 3.057715892791748s
Received healthy response to inference request in 1.9023878574371338s
Received healthy response to inference request in 3.088510036468506s
Received healthy response to inference request in 2.947201728820801s
10 requests
0 failed requests
5th percentile: 2.2233261823654176
10th percentile: 2.5442645072937013
20th percentile: 2.880878210067749
30th percentile: 3.024561643600464
40th percentile: 3.0761923789978027
50th percentile: 3.198045492172241
60th percentile: 3.4444236755371094
70th percentile: 3.7227194547653197
80th percentile: 3.9712192535400392
90th percentile: 4.32791793346405
95th percentile: 4.527396500110625
99th percentile: 4.686979353427887
mean time: 3.3472259521484373
Pipeline stage StressChecker completed in 84.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.54s
Shutdown handler de-registered
function_nagis_2025-12-15 status is now deployed due to DeploymentManager action
function_nagis_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_nagis_2025-12-15 status is now torndown due to DeploymentManager action