developer_uid: chai_evaluation_service
submission_id: function_difaf_2025-12-13
model_name: richard
model_group:
status: inactive
timestamp: 2025-12-13T06:46:40+00:00
num_battles: 8062
num_wins: 4161
celo_rating: 1256.31
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-12
win_ratio: 0.516125031009675
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.9651243686676025s
Received healthy response to inference request in 4.259036540985107s
Received healthy response to inference request in 4.917905569076538s
Received healthy response to inference request in 2.7605788707733154s
Received healthy response to inference request in 2.747068166732788s
Received healthy response to inference request in 2.174015998840332s
Received healthy response to inference request in 3.4829864501953125s
Received healthy response to inference request in 2.840214729309082s
Received healthy response to inference request in 3.3557088375091553s
10 requests
1 failed requests
5th percentile: 2.059125602245331
10th percentile: 2.153126835823059
20th percentile: 2.632457733154297
30th percentile: 2.756525659561157
40th percentile: 2.808360385894775
50th percentile: 3.0979617834091187
60th percentile: 3.4066198825836183
70th percentile: 3.715801477432251
80th percentile: 4.390810346603394
90th percentile: 6.4361958026885935
95th percentile: 13.268501853942855
99th percentile: 18.73434669494629
mean time: 4.860344743728637
%s, retrying in %s seconds...
Received healthy response to inference request in 3.0362648963928223s
Received healthy response to inference request in 2.8238213062286377s
Received healthy response to inference request in 2.59437894821167s
Received healthy response to inference request in 3.3054287433624268s
Received healthy response to inference request in 2.2320780754089355s
Received healthy response to inference request in 2.3671457767486572s
Received healthy response to inference request in 2.747075080871582s
Received healthy response to inference request in 2.2026188373565674s
Received healthy response to inference request in 2.453463554382324s
Received healthy response to inference request in 3.272509813308716s
10 requests
0 failed requests
5th percentile: 2.215875494480133
10th percentile: 2.229132151603699
20th percentile: 2.340132236480713
30th percentile: 2.427568221092224
40th percentile: 2.5380127906799315
50th percentile: 2.670727014541626
60th percentile: 2.7777735710144045
70th percentile: 2.887554383277893
80th percentile: 3.083513879776001
90th percentile: 3.2758017063140867
95th percentile: 3.2906152248382567
99th percentile: 3.3024660396575927
mean time: 2.7034785032272337
Pipeline stage StressChecker completed in 78.50s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.57s
Shutdown handler de-registered
function_difaf_2025-12-13 status is now deployed due to DeploymentManager action
function_difaf_2025-12-13 status is now inactive due to auto deactivation removed underperforming models