function_nohir_2025-12-18

developer_uid: chai_evaluation_service

submission_id: function_nohir_2025-12-18

model_name: richard

model_group:

status: torndown

timestamp: 2025-12-21T08:51:14+00:00

num_battles: 7472

num_wins: 3695

celo_rating: 1289.57

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: richard

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-21

win_ratio: 0.49451284796573874

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.8998968601226807s
Received healthy response to inference request in 2.1455676555633545s
Received healthy response to inference request in 2.2703857421875s
Received healthy response to inference request in 2.0271832942962646s
Received healthy response to inference request in 2.706120729446411s
Received healthy response to inference request in 2.4640979766845703s
Received healthy response to inference request in 3.1995389461517334s
Received healthy response to inference request in 2.721881866455078s
Received healthy response to inference request in 2.7727463245391846s
10 requests
1 failed requests
5th percentile: 1.9571757555007934
10th percentile: 2.014454650878906
20th percentile: 2.1218907833099365
30th percentile: 2.2329403162002563
40th percentile: 2.3866130828857424
50th percentile: 2.5851093530654907
60th percentile: 2.712425184249878
70th percentile: 2.7371412038803102
80th percentile: 2.8581048488616942
90th percentile: 4.890697956085199
95th percentile: 12.50091350078581
99th percentile: 18.58908593654633
mean time: 4.231854844093323
%s, retrying in %s seconds...
Received healthy response to inference request in 3.9177680015563965s
Received healthy response to inference request in 2.134049892425537s
Received healthy response to inference request in 3.316535711288452s
Received healthy response to inference request in 3.060222625732422s
Received healthy response to inference request in 2.6035850048065186s
Received healthy response to inference request in 1.9072575569152832s
Received healthy response to inference request in 1.8144919872283936s
Received healthy response to inference request in 2.4851908683776855s
Received healthy response to inference request in 1.9513695240020752s
Received healthy response to inference request in 1.945542573928833s
10 requests
0 failed requests
5th percentile: 1.856236493587494
10th percentile: 1.8979809999465942
20th percentile: 1.937885570526123
30th percentile: 1.9496214389801025
40th percentile: 2.060977745056152
50th percentile: 2.3096203804016113
60th percentile: 2.532548522949219
70th percentile: 2.7405762910842895
80th percentile: 3.111485242843628
90th percentile: 3.3766589403152465
95th percentile: 3.647213470935821
99th percentile: 3.8636570954322815
mean time: 2.51360137462616
Pipeline stage StressChecker completed in 69.94s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.57s
Shutdown handler de-registered
function_nohir_2025-12-18 status is now deployed due to DeploymentManager action
function_nohir_2025-12-18 status is now inactive due to auto deactivation removed underperforming models
function_nohir_2025-12-18 status is now torndown due to DeploymentManager action