function_mijun_2025-12-13

developer_uid: chai_evaluation_service

submission_id: function_mijun_2025-12-13

model_name: richard

model_group:

status: inactive

timestamp: 2025-12-13T20:17:22+00:00

num_battles: 10822

num_wins: 5280

celo_rating: 1256.32

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: richard

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-13

win_ratio: 0.48789502864535206

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.7012789249420166s
Received healthy response to inference request in 1.6658406257629395s
Received healthy response to inference request in 2.136134624481201s
Received healthy response to inference request in 1.9058737754821777s
Received healthy response to inference request in 1.9672911167144775s
Received healthy response to inference request in 2.1578867435455322s
Received healthy response to inference request in 1.9131479263305664s
Received healthy response to inference request in 1.881347894668579s
Received healthy response to inference request in 1.6748228073120117s
10 requests
1 failed requests
5th percentile: 1.669882607460022
10th percentile: 1.6739245891571044
20th percentile: 1.6959877014160156
30th percentile: 1.8273272037506103
40th percentile: 1.8960634231567384
50th percentile: 1.909510850906372
60th percentile: 1.934805202484131
70th percentile: 2.017944169044495
80th percentile: 2.1404850482940674
90th percentile: 3.9532406091689998
95th percentile: 12.032333004474621
99th percentile: 18.495606920719148
mean time: 3.7115049839019774
%s, retrying in %s seconds...
Received healthy response to inference request in 1.9507701396942139s
Received healthy response to inference request in 1.7953910827636719s
Received healthy response to inference request in 2.0251262187957764s
Received healthy response to inference request in 2.3025150299072266s
Received healthy response to inference request in 2.6166582107543945s
Received healthy response to inference request in 2.5008950233459473s
Received healthy response to inference request in 1.7701053619384766s
Received healthy response to inference request in 2.1241018772125244s
Received healthy response to inference request in 1.771073818206787s
Received healthy response to inference request in 2.3221824169158936s
10 requests
0 failed requests
5th percentile: 1.7705411672592164
10th percentile: 1.770976972579956
20th percentile: 1.790527629852295
30th percentile: 1.9041564226150511
40th percentile: 1.9953837871551514
50th percentile: 2.0746140480041504
60th percentile: 2.195467138290405
70th percentile: 2.308415246009827
80th percentile: 2.3579249382019043
90th percentile: 2.512471342086792
95th percentile: 2.564564776420593
99th percentile: 2.606239523887634
mean time: 2.117881917953491
Pipeline stage StressChecker completed in 60.89s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.55s
Shutdown handler de-registered
function_mijun_2025-12-13 status is now deployed due to DeploymentManager action
function_mijun_2025-12-13 status is now inactive due to auto deactivation removed underperforming models