developer_uid: chai_backend_admin
submission_id: function_tipem_2025-07-08
model_name: function_tipem_2025-07-08
model_group:
status: torndown
timestamp: 2025-07-08T17:24:52+00:00
num_battles: 9320
num_wins: 4744
celo_rating: 1297.43
family_friendly_score: 0.5256000000000001
family_friendly_standard_error: 0.007061793539887725
submission_type: function
display_name: function_tipem_2025-07-08
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-07-08
win_ratio: 0.5090128755364807
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.904567003250122s
Received healthy response to inference request in 2.7139532566070557s
Received healthy response to inference request in 3.1529228687286377s
Received healthy response to inference request in 4.657815933227539s
Received healthy response to inference request in 4.698521375656128s
5 requests
0 failed requests
5th percentile: 2.752076005935669
10th percentile: 2.7901987552642824
20th percentile: 2.8664442539215087
30th percentile: 2.954238176345825
40th percentile: 3.0535805225372314
50th percentile: 3.1529228687286377
60th percentile: 3.754880094528198
70th percentile: 4.356837320327759
80th percentile: 4.665957021713257
90th percentile: 4.682239198684693
95th percentile: 4.69038028717041
99th percentile: 4.696893157958985
mean time: 3.6255560874938966
%s, retrying in %s seconds...
Received healthy response to inference request in 4.217672824859619s
Received healthy response to inference request in 2.721320390701294s
Received healthy response to inference request in 3.2900657653808594s
Received healthy response to inference request in 4.777932643890381s
Received healthy response to inference request in 2.1820757389068604s
5 requests
0 failed requests
5th percentile: 2.289924669265747
10th percentile: 2.397773599624634
20th percentile: 2.6134714603424074
30th percentile: 2.835069465637207
40th percentile: 3.062567615509033
50th percentile: 3.2900657653808594
60th percentile: 3.6611085891723634
70th percentile: 4.032151412963867
80th percentile: 4.3297247886657715
90th percentile: 4.553828716278076
95th percentile: 4.6658806800842285
99th percentile: 4.75552225112915
mean time: 3.437813472747803
%s, retrying in %s seconds...
Received healthy response to inference request in 3.3827340602874756s
Received healthy response to inference request in 3.884439706802368s
Received healthy response to inference request in 2.04962420463562s
Received healthy response to inference request in 3.7496132850646973s
Received healthy response to inference request in 3.13805890083313s
5 requests
0 failed requests
5th percentile: 2.267311143875122
10th percentile: 2.484998083114624
20th percentile: 2.920371961593628
30th percentile: 3.186993932723999
40th percentile: 3.284863996505737
50th percentile: 3.3827340602874756
60th percentile: 3.529485750198364
70th percentile: 3.676237440109253
80th percentile: 3.7765785694122314
90th percentile: 3.8305091381073
95th percentile: 3.857474422454834
99th percentile: 3.8790466499328615
mean time: 3.2408940315246584
Pipeline stage StressChecker completed in 55.66s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.90s
Shutdown handler de-registered
function_tipem_2025-07-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4135.90s
Shutdown handler de-registered
function_tipem_2025-07-08 status is now inactive due to auto deactivation removed underperforming models
function_tipem_2025-07-08 status is now torndown due to DeploymentManager action