developer_uid: chai_backend_admin
submission_id: function_jejem_2025-12-12
model_name: function_jejem_2025-12-12
model_group:
status: inactive
timestamp: 2025-12-12T17:27:04+00:00
num_battles: 5383
num_wins: 2434
celo_rating: 1473.3
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_jejem_2025-12-12
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-12-12
win_ratio: 0.45216422069477985
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 2.161519765853882s
Received healthy response to inference request in 4.0176544189453125s
Received healthy response to inference request in 2.3822593688964844s
Received healthy response to inference request in 2.4271233081817627s
Received healthy response to inference request in 3.6010184288024902s
Received healthy response to inference request in 2.1993820667266846s
Received healthy response to inference request in 1.5550143718719482s
Received healthy response to inference request in 1.943270206451416s
Received healthy response to inference request in 2.336195707321167s
10 requests
1 failed requests
5th percentile: 1.7297294974327087
10th percentile: 1.9044446229934693
20th percentile: 2.1178698539733887
30th percentile: 2.1880233764648436
40th percentile: 2.281470251083374
50th percentile: 2.3592275381088257
60th percentile: 2.4002049446105955
70th percentile: 2.7792918443679806
80th percentile: 3.6843456268310546
90th percentile: 6.031674790382378
95th percentile: 15.094766461849192
99th percentile: 22.34523979902268
mean time: 4.678129577636719
%s, retrying in %s seconds...
Received healthy response to inference request in 1.573753833770752s
Received healthy response to inference request in 1.548755407333374s
Received healthy response to inference request in 1.2336997985839844s
Received healthy response to inference request in 2.2006821632385254s
Received healthy response to inference request in 1.6407413482666016s
Received healthy response to inference request in 2.557734966278076s
Received healthy response to inference request in 2.4939703941345215s
Received healthy response to inference request in 2.0871517658233643s
Received healthy response to inference request in 1.6137478351593018s
Received healthy response to inference request in 1.8734180927276611s
10 requests
0 failed requests
5th percentile: 1.3754748225212097
10th percentile: 1.517249846458435
20th percentile: 1.5687541484832763
30th percentile: 1.601749634742737
40th percentile: 1.6299439430236817
50th percentile: 1.7570797204971313
60th percentile: 1.9589115619659423
70th percentile: 2.1212108850479128
80th percentile: 2.2593398094177246
90th percentile: 2.500346851348877
95th percentile: 2.5290409088134767
99th percentile: 2.551996154785156
mean time: 1.8823655605316163
Pipeline stage StressChecker completed in 69.43s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_jejem_2025-12-12 status is now deployed due to DeploymentManager action
function_jejem_2025-12-12 status is now inactive due to auto deactivation removed underperforming models