developer_uid: chai_evaluation_service
submission_id: function_dires_2025-12-14
model_name: richard
model_group:
status: inactive
timestamp: 2025-12-14T11:26:46+00:00
num_battles: 8273
num_wins: 3981
celo_rating: 1256.38
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-14
win_ratio: 0.4812039163544059
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 4.8144690990448s
Received healthy response to inference request in 3.823227882385254s
Received healthy response to inference request in 3.8180129528045654s
Received healthy response to inference request in 3.9339029788970947s
Received healthy response to inference request in 3.5515668392181396s
Received healthy response to inference request in 2.3537628650665283s
Received healthy response to inference request in 4.19507908821106s
Received healthy response to inference request in 3.65193772315979s
Received healthy response to inference request in 5.675249099731445s
10 requests
1 failed requests
5th percentile: 2.8927746534347536
10th percentile: 3.4317864418029784
20th percentile: 3.63186354637146
30th percentile: 3.768190383911133
40th percentile: 3.8211419105529787
50th percentile: 3.8785654306411743
60th percentile: 4.038373422622681
70th percentile: 4.380896091461182
80th percentile: 4.986625099182129
90th percentile: 7.118011403083797
95th percentile: 13.610441768169387
99th percentile: 18.804386060237885
mean time: 5.592008066177368
%s, retrying in %s seconds...
Received healthy response to inference request in 3.6666274070739746s
Received healthy response to inference request in 2.7814295291900635s
Received healthy response to inference request in 3.213010787963867s
Received healthy response to inference request in 4.639589786529541s
Received healthy response to inference request in 3.7177062034606934s
Received healthy response to inference request in 4.462111949920654s
Received healthy response to inference request in 2.870771884918213s
Received healthy response to inference request in 3.057035446166992s
Received healthy response to inference request in 3.47584867477417s
Received healthy response to inference request in 2.9859721660614014s
10 requests
0 failed requests
5th percentile: 2.821633589267731
10th percentile: 2.861837649345398
20th percentile: 2.9629321098327637
30th percentile: 3.0357164621353148
40th percentile: 3.1506206512451174
50th percentile: 3.3444297313690186
60th percentile: 3.5521601676940917
70th percentile: 3.6819510459899902
80th percentile: 3.8665873527526857
90th percentile: 4.479859733581543
95th percentile: 4.559724760055542
99th percentile: 4.623616781234741
mean time: 3.487010383605957
Pipeline stage StressChecker completed in 93.38s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.11s
Shutdown handler de-registered
function_dires_2025-12-14 status is now deployed due to DeploymentManager action
function_dires_2025-12-14 status is now inactive due to auto deactivation removed underperforming models