developer_uid: chai_evaluation_service
submission_id: function_sulib_2025-12-15
model_name: richard
model_group:
status: inactive
timestamp: 2025-12-15T07:17:12+00:00
num_battles: 8872
num_wins: 4497
celo_rating: 1297.39
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-14
win_ratio: 0.5068755635707844
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.8388683795928955s
Received healthy response to inference request in 1.943413257598877s
Received healthy response to inference request in 3.116450071334839s
Received healthy response to inference request in 2.83182954788208s
Received healthy response to inference request in 3.311188220977783s
Received healthy response to inference request in 7.315382242202759s
Received healthy response to inference request in 1.9146392345428467s
Received healthy response to inference request in 3.318932294845581s
Received healthy response to inference request in 2.7948994636535645s
10 requests
1 failed requests
5th percentile: 1.9275875449180604
10th percentile: 1.9405358552932739
20th percentile: 2.624602222442627
30th percentile: 2.820750522613525
40th percentile: 2.8360528469085695
50th percentile: 2.977659225463867
60th percentile: 3.1943453311920167
70th percentile: 3.3135114431381227
80th percentile: 4.118222284317017
90th percentile: 8.595676088333125
95th percentile: 14.356998395919785
99th percentile: 18.966056241989136
mean time: 4.950392341613769
%s, retrying in %s seconds...
Received healthy response to inference request in 3.3228375911712646s
Received healthy response to inference request in 1.6710872650146484s
Received healthy response to inference request in 2.5956263542175293s
Received healthy response to inference request in 1.8852384090423584s
Received healthy response to inference request in 1.9010815620422363s
Received healthy response to inference request in 4.195974826812744s
Received healthy response to inference request in 2.2524471282958984s
Received healthy response to inference request in 2.6031272411346436s
Received healthy response to inference request in 3.2584025859832764s
Received healthy response to inference request in 2.3183350563049316s
10 requests
0 failed requests
5th percentile: 1.767455279827118
10th percentile: 1.8638232946395874
20th percentile: 1.8979129314422607
30th percentile: 2.1470374584197995
40th percentile: 2.2919798851013184
50th percentile: 2.4569807052612305
60th percentile: 2.598626708984375
70th percentile: 2.799709844589233
80th percentile: 3.271289587020874
90th percentile: 3.4101513147354123
95th percentile: 3.8030630707740776
99th percentile: 4.117392475605011
mean time: 2.600415802001953
Pipeline stage StressChecker completed in 77.97s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.57s
Shutdown handler de-registered
function_sulib_2025-12-15 status is now deployed due to DeploymentManager action
function_sulib_2025-12-15 status is now inactive due to auto deactivation removed underperforming models