developer_uid: chai_evaluation_service
submission_id: function_korus_2025-12-14
model_name: richard
model_group:
status: inactive
timestamp: 2025-12-14T06:26:57+00:00
num_battles: 7476
num_wins: 3710
celo_rating: 1256.35
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-13
win_ratio: 0.49625468164794007
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.46366810798645s
Received healthy response to inference request in 2.3035173416137695s
Received healthy response to inference request in 2.0735676288604736s
Received healthy response to inference request in 2.701788902282715s
Received healthy response to inference request in 2.0877130031585693s
Received healthy response to inference request in 1.6563098430633545s
Received healthy response to inference request in 1.7477645874023438s
Received healthy response to inference request in 2.653864622116089s
Received healthy response to inference request in 3.0568740367889404s
10 requests
1 failed requests
5th percentile: 1.6974644780158996
10th percentile: 1.7386191129684447
20th percentile: 2.0084070205688476
30th percentile: 2.0834693908691406
40th percentile: 2.2171956062316895
50th percentile: 2.38359272480011
60th percentile: 2.5397467136383054
70th percentile: 2.6682419061660765
80th percentile: 2.77280592918396
90th percentile: 4.7613205432891785
95th percentile: 12.431329822540265
99th percentile: 18.567337245941165
mean time: 4.084640717506408
%s, retrying in %s seconds...
Received healthy response to inference request in 2.5325353145599365s
Received healthy response to inference request in 3.5048961639404297s
Received healthy response to inference request in 1.8667943477630615s
Received healthy response to inference request in 2.167583465576172s
Received healthy response to inference request in 2.094622850418091s
Received healthy response to inference request in 2.3010354042053223s
Received healthy response to inference request in 2.5487444400787354s
Received healthy response to inference request in 2.4820029735565186s
Received healthy response to inference request in 1.7963080406188965s
Received healthy response to inference request in 1.636378526687622s
10 requests
0 failed requests
5th percentile: 1.7083468079566955
10th percentile: 1.780315089225769
20th percentile: 1.8526970863342285
30th percentile: 2.026274299621582
40th percentile: 2.1383992195129395
50th percentile: 2.234309434890747
60th percentile: 2.3734224319458006
70th percentile: 2.497162675857544
80th percentile: 2.535777139663696
90th percentile: 2.6443596124649043
95th percentile: 3.074627888202666
99th percentile: 3.4188425087928773
mean time: 2.2930901527404783
Pipeline stage StressChecker completed in 66.50s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_korus_2025-12-14 status is now deployed due to DeploymentManager action
function_korus_2025-12-14 status is now inactive due to auto deactivation removed underperforming models