developer_uid: chai_backend_admin
submission_id: function_jomof_2025-05-12
model_name: function_jomof_2025-05-12
model_group:
status: torndown
timestamp: 2025-05-12T22:17:07+00:00
num_battles: 4691000
num_wins: 2468941
celo_rating: 1299.92
family_friendly_score: 0.5549999999999999
family_friendly_standard_error: 0.007028157653325657
submission_type: function
display_name: function_jomof_2025-05-12
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-12
win_ratio: 0.5263144318908548
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.838616609573364s
Received healthy response to inference request in 2.0193965435028076s
Received healthy response to inference request in 3.2656915187835693s
Failed to get response for submission chaiml-collin-servant-pr_8683_v1: HTTPConnectionPool(host='chaiml-collin-servant-pr-8683-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 5.665562152862549s
Received healthy response to inference request in 4.142943382263184s
5 requests
0 failed requests
5th percentile: 2.26865553855896
10th percentile: 2.5179145336151123
20th percentile: 3.016432523727417
30th percentile: 3.441141891479492
40th percentile: 3.792042636871338
50th percentile: 4.142943382263184
60th percentile: 4.421212673187256
70th percentile: 4.699481964111328
80th percentile: 5.004005718231201
90th percentile: 5.334783935546875
95th percentile: 5.500173044204712
99th percentile: 5.632484331130981
mean time: 3.986442041397095
%s, retrying in %s seconds...
Received healthy response to inference request in 3.357727289199829s
Received healthy response to inference request in 3.3459768295288086s
Received healthy response to inference request in 3.617741584777832s
Received healthy response to inference request in 2.759491443634033s
Received healthy response to inference request in 4.352315187454224s
5 requests
0 failed requests
5th percentile: 2.876788520812988
10th percentile: 2.994085597991943
20th percentile: 3.2286797523498536
30th percentile: 3.3483269214630127
40th percentile: 3.353027105331421
50th percentile: 3.357727289199829
60th percentile: 3.46173300743103
70th percentile: 3.5657387256622313
80th percentile: 3.7646563053131104
90th percentile: 4.058485746383667
95th percentile: 4.205400466918945
99th percentile: 4.322932243347168
mean time: 3.4866504669189453
Pipeline stage StressChecker completed in 39.67s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.64s
Shutdown handler de-registered
function_jomof_2025-05-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3476.16s
Shutdown handler de-registered
function_jomof_2025-05-12 status is now inactive due to auto deactivation removed underperforming models
function_jomof_2025-05-12 status is now torndown due to DeploymentManager action