function_gisob_2025-12-16

developer_uid: chai_evaluation_service

submission_id: function_gisob_2025-12-16

model_name: richard

model_group:

status: torndown

timestamp: 2025-12-19T06:21:18+00:00

num_battles: 8538

num_wins: 4302

celo_rating: 1295.81

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: richard

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-18

win_ratio: 0.5038650737877723

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 1.9570789337158203s
Received healthy response to inference request in 2.348299980163574s
Received healthy response to inference request in 3.017803907394409s
Received healthy response to inference request in 4.215071201324463s
Received healthy response to inference request in 3.4213602542877197s
Received healthy response to inference request in 2.3776028156280518s
Received healthy response to inference request in 2.0436525344848633s
Received healthy response to inference request in 3.181126594543457s
Received healthy response to inference request in 3.32655930519104s
10 requests
1 failed requests
5th percentile: 1.9960370540618897
10th percentile: 2.034995174407959
20th percentile: 2.287370491027832
30th percentile: 2.3688119649887085
40th percentile: 2.7617234706878664
50th percentile: 3.099465250968933
60th percentile: 3.23929967880249
70th percentile: 3.3549995899200438
80th percentile: 3.5801024436950684
90th percentile: 5.817005944252008
95th percentile: 13.025712287425979
99th percentile: 18.792677361965183
mean time: 4.612297415733337
%s, retrying in %s seconds...
Received healthy response to inference request in 2.763383626937866s
Received healthy response to inference request in 2.181218147277832s
Received healthy response to inference request in 4.420161485671997s
Received healthy response to inference request in 4.089984893798828s
Received healthy response to inference request in 3.158351421356201s
Received healthy response to inference request in 2.2384743690490723s
Received healthy response to inference request in 3.5606613159179688s
Received healthy response to inference request in 3.3433914184570312s
Received healthy response to inference request in 3.1995034217834473s
Received healthy response to inference request in 2.972364902496338s
10 requests
0 failed requests
5th percentile: 2.20698344707489
10th percentile: 2.2327487468719482
20th percentile: 2.6584017753601072
30th percentile: 2.909670519828796
40th percentile: 3.083956813812256
50th percentile: 3.178927421569824
60th percentile: 3.257058620452881
70th percentile: 3.4085723876953127
80th percentile: 3.666526031494141
90th percentile: 4.1230025529861445
95th percentile: 4.27158201932907
99th percentile: 4.390445592403412
mean time: 3.192749500274658
Pipeline stage StressChecker completed in 81.78s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_gisob_2025-12-16 status is now deployed due to DeploymentManager action
function_gisob_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_gisob_2025-12-16 status is now torndown due to DeploymentManager action