developer_uid: chai_evaluation_service
submission_id: function_kenut_2025-12-19
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-22T01:06:22+00:00
num_battles: 8933
num_wins: 4434
celo_rating: 1290.6
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-21
win_ratio: 0.4963618045449457
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 4.36699652671814s
Received healthy response to inference request in 2.070291042327881s
Received healthy response to inference request in 3.02459979057312s
Received healthy response to inference request in 2.9951393604278564s
Received healthy response to inference request in 2.3748233318328857s
Received healthy response to inference request in 2.8700413703918457s
Received healthy response to inference request in 4.0937581062316895s
Received healthy response to inference request in 3.2237086296081543s
Received healthy response to inference request in 5.03171968460083s
10 requests
1 failed requests
5th percentile: 2.207330572605133
10th percentile: 2.3443701028823853
20th percentile: 2.7709977626800537
30th percentile: 2.9576099634170534
40th percentile: 3.0128156185150146
50th percentile: 3.124154210090637
60th percentile: 3.5717284202575676
70th percentile: 4.1757296323776245
80th percentile: 4.499941158294678
90th percentile: 6.585715723037714
95th percentile: 13.578697896003707
99th percentile: 19.17308363437653
mean time: 5.062275791168213
%s, retrying in %s seconds...
Received healthy response to inference request in 4.27775239944458s
Received healthy response to inference request in 2.7021067142486572s
Received healthy response to inference request in 4.81243371963501s
Received healthy response to inference request in 3.458069086074829s
Received healthy response to inference request in 2.5832481384277344s
Received healthy response to inference request in 3.573862075805664s
Received healthy response to inference request in 2.894390344619751s
Received healthy response to inference request in 1.7327167987823486s
Received healthy response to inference request in 3.41507887840271s
Received healthy response to inference request in 1.9892356395721436s
10 requests
0 failed requests
5th percentile: 1.8481502771377563
10th percentile: 1.963583755493164
20th percentile: 2.464445638656616
30th percentile: 2.6664491415023805
40th percentile: 2.8174768924713134
50th percentile: 3.1547346115112305
60th percentile: 3.4322749614715575
70th percentile: 3.4928069829940798
80th percentile: 3.7146401405334473
90th percentile: 4.3312205314636225
95th percentile: 4.571827125549316
99th percentile: 4.764312400817871
mean time: 3.143889379501343
Pipeline stage StressChecker completed in 84.82s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_kenut_2025-12-19 status is now deployed due to DeploymentManager action
function_kenut_2025-12-19 status is now inactive due to auto deactivation removed underperforming models
function_kenut_2025-12-19 status is now torndown due to DeploymentManager action