developer_uid: chai_evaluation_service
submission_id: function_kukob_2025-12-15
model_name: richard
model_group:
status: torndown
timestamp: 2025-12-18T08:31:09+00:00
num_battles: 7226
num_wins: 3698
celo_rating: 1301.12
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: richard
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-18
win_ratio: 0.5117630777747024
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.9541380405426025s
Received healthy response to inference request in 2.223844528198242s
Received healthy response to inference request in 1.8962876796722412s
Received healthy response to inference request in 2.7510921955108643s
Received healthy response to inference request in 2.864490032196045s
Received healthy response to inference request in 3.039088487625122s
Received healthy response to inference request in 2.5511152744293213s
Received healthy response to inference request in 2.244673013687134s
Received healthy response to inference request in 2.4777681827545166s
10 requests
1 failed requests
5th percentile: 1.922320342063904
10th percentile: 1.9483530044555664
20th percentile: 2.1699032306671144
30th percentile: 2.238424468040466
40th percentile: 2.3845301151275633
50th percentile: 2.514441728591919
60th percentile: 2.6311060428619384
70th percentile: 2.7851115465164185
80th percentile: 2.8994097232818605
90th percentile: 4.760065746307367
95th percentile: 12.504463410377484
99th percentile: 18.69998154163361
mean time: 4.225135850906372
%s, retrying in %s seconds...
Received healthy response to inference request in 2.4091103076934814s
Received healthy response to inference request in 2.1687417030334473s
Received healthy response to inference request in 2.1319944858551025s
Received healthy response to inference request in 1.7920372486114502s
Received healthy response to inference request in 2.3447389602661133s
Received healthy response to inference request in 2.819343090057373s
Received healthy response to inference request in 1.7308831214904785s
Received healthy response to inference request in 2.3235089778900146s
Received healthy response to inference request in 2.9043266773223877s
Received healthy response to inference request in 3.3232760429382324s
10 requests
0 failed requests
5th percentile: 1.7584024786949157
10th percentile: 1.785921835899353
20th percentile: 2.064003038406372
30th percentile: 2.157717537879944
40th percentile: 2.2616020679473876
50th percentile: 2.334123969078064
60th percentile: 2.3704874992370604
70th percentile: 2.5321801424026487
80th percentile: 2.836339807510376
90th percentile: 2.946221613883972
95th percentile: 3.134748828411102
99th percentile: 3.2855706000328064
mean time: 2.394796061515808
Pipeline stage StressChecker completed in 69.45s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.95s
Shutdown handler de-registered
function_kukob_2025-12-15 status is now deployed due to DeploymentManager action
function_kukob_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_kukob_2025-12-15 status is now torndown due to DeploymentManager action