function_bifof_2025-12-15

developer_uid: chai_evaluation_service

submission_id: function_bifof_2025-12-15

model_name: richard

model_group:

status: torndown

timestamp: 2025-12-18T09:41:45+00:00

num_battles: 7167

num_wins: 3599

celo_rating: 1294.79

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: richard

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-18

win_ratio: 0.5021626901074369

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.283940553665161s
Received healthy response to inference request in 2.3138692378997803s
Received healthy response to inference request in 1.92503023147583s
Received healthy response to inference request in 2.7147305011749268s
Received healthy response to inference request in 2.1030657291412354s
Received healthy response to inference request in 1.673949956893921s
Received healthy response to inference request in 2.0047218799591064s
Received healthy response to inference request in 2.758458375930786s
Received healthy response to inference request in 2.4838831424713135s
10 requests
1 failed requests
5th percentile: 1.7869360804557801
10th percentile: 1.8999222040176391
20th percentile: 1.9887835502624511
30th percentile: 2.073562574386597
40th percentile: 2.211590623855591
50th percentile: 2.2989048957824707
60th percentile: 2.3818747997283936
70th percentile: 2.5531373500823973
80th percentile: 2.7234760761260985
90th percentile: 4.494518828392023
95th percentile: 12.306790864467603
99th percentile: 18.556608493328095
mean time: 4.038071250915527
%s, retrying in %s seconds...
Received healthy response to inference request in 1.8334732055664062s
Received healthy response to inference request in 2.755751371383667s
Received healthy response to inference request in 1.9105582237243652s
Received healthy response to inference request in 2.9088077545166016s
Received healthy response to inference request in 1.8316831588745117s
Received healthy response to inference request in 1.9605708122253418s
Received healthy response to inference request in 1.8148167133331299s
Received healthy response to inference request in 2.7405545711517334s
Received healthy response to inference request in 2.6167726516723633s
Received healthy response to inference request in 2.790745496749878s
10 requests
0 failed requests
5th percentile: 1.8224066138267516
10th percentile: 1.8299965143203736
20th percentile: 1.8331151962280274
30th percentile: 1.8874327182769775
40th percentile: 1.9405657768249511
50th percentile: 2.2886717319488525
60th percentile: 2.6662854194641112
70th percentile: 2.7451136112213135
80th percentile: 2.762750196456909
90th percentile: 2.8025517225265504
95th percentile: 2.8556797385215758
99th percentile: 2.8981821513175965
mean time: 2.3163733959197996
Pipeline stage StressChecker completed in 67.54s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_bifof_2025-12-15 status is now deployed due to DeploymentManager action
function_bifof_2025-12-15 status is now inactive due to auto deactivation removed underperforming models
function_bifof_2025-12-15 status is now torndown due to DeploymentManager action