function_gebem_2025-12-16

developer_uid: chai_evaluation_service

submission_id: function_gebem_2025-12-16

model_name: richard

model_group:

status: torndown

timestamp: 2025-12-19T06:21:18+00:00

num_battles: 8751

num_wins: 4372

celo_rating: 1293.11

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: richard

is_internal_developer: True

ranking_group: single

us_pacific_date: 2025-12-18

win_ratio: 0.4996000457090618

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.212415933609009s
Received healthy response to inference request in 1.9119517803192139s
Received healthy response to inference request in 2.7700769901275635s
Received healthy response to inference request in 3.2583909034729004s
Received healthy response to inference request in 2.3720009326934814s
Received healthy response to inference request in 3.1788501739501953s
Received healthy response to inference request in 2.592818260192871s
Received healthy response to inference request in 2.4115376472473145s
Received healthy response to inference request in 3.0801117420196533s
10 requests
1 failed requests
5th percentile: 2.0471606492996215
10th percentile: 2.182369518280029
20th percentile: 2.340083932876587
30th percentile: 2.3996766328811647
40th percentile: 2.5203060150146483
50th percentile: 2.6814476251602173
60th percentile: 2.8940908908843994
70th percentile: 3.1097332715988157
80th percentile: 3.1947583198547362
90th percentile: 4.94394752979278
95th percentile: 12.528952348232252
99th percentile: 18.596956202983858
mean time: 4.390211153030395
%s, retrying in %s seconds...
Received healthy response to inference request in 2.949012041091919s
Received healthy response to inference request in 2.2177844047546387s
Received healthy response to inference request in 2.2611076831817627s
Received healthy response to inference request in 1.7277271747589111s
Received healthy response to inference request in 2.0709877014160156s
Received healthy response to inference request in 2.067774772644043s
Received healthy response to inference request in 2.4010560512542725s
Received healthy response to inference request in 2.631324052810669s
Received healthy response to inference request in 2.496257781982422s
Received healthy response to inference request in 3.2029900550842285s
10 requests
0 failed requests
5th percentile: 1.8807485938072204
10th percentile: 2.0337700128555296
20th percentile: 2.0703451156616213
30th percentile: 2.1737453937530518
40th percentile: 2.243778371810913
50th percentile: 2.3310818672180176
60th percentile: 2.4391367435455322
70th percentile: 2.536777663230896
80th percentile: 2.694861650466919
90th percentile: 2.97440984249115
95th percentile: 3.088699948787689
99th percentile: 3.1801320338249206
mean time: 2.4026021718978883
Pipeline stage StressChecker completed in 71.15s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_gebem_2025-12-16 status is now deployed due to DeploymentManager action
function_gebem_2025-12-16 status is now inactive due to auto deactivation removed underperforming models
function_gebem_2025-12-16 status is now torndown due to DeploymentManager action