developer_uid: chai_backend_admin
submission_id: function_kiguk_2025-05-23
model_name: function_kiguk_2025-05-23
model_group:
status: torndown
timestamp: 2025-05-23T15:25:17+00:00
num_battles: 6154
num_wins: 3077
celo_rating: 1291.89
family_friendly_score: 0.5284
family_friendly_standard_error: 0.007059652116074842
submission_type: function
display_name: function_kiguk_2025-05-23
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-23
win_ratio: 0.5
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.658775806427002s
Received healthy response to inference request in 3.644998550415039s
Received healthy response to inference request in 4.3973541259765625s
Received healthy response to inference request in 3.211791515350342s
Received healthy response to inference request in 2.6587257385253906s
5 requests
0 failed requests
5th percentile: 2.7693388938903807
10th percentile: 2.879952049255371
20th percentile: 3.1011783599853517
30th percentile: 3.2984329223632813
40th percentile: 3.47171573638916
50th percentile: 3.644998550415039
60th percentile: 3.9459407806396483
70th percentile: 4.2468830108642575
80th percentile: 4.44963846206665
90th percentile: 4.554207134246826
95th percentile: 4.606491470336914
99th percentile: 4.648318939208984
mean time: 3.714329147338867
%s, retrying in %s seconds...
Received healthy response to inference request in 3.6070830821990967s
Received healthy response to inference request in 2.5302371978759766s
Received healthy response to inference request in 3.6886518001556396s
Received healthy response to inference request in 3.6453030109405518s
Received healthy response to inference request in 3.6079134941101074s
5 requests
0 failed requests
5th percentile: 2.7456063747406008
10th percentile: 2.9609755516052245
20th percentile: 3.3917139053344725
30th percentile: 3.6072491645812987
40th percentile: 3.6075813293457033
50th percentile: 3.6079134941101074
60th percentile: 3.622869300842285
70th percentile: 3.637825107574463
80th percentile: 3.6539727687835692
90th percentile: 3.6713122844696047
95th percentile: 3.679982042312622
99th percentile: 3.686917848587036
mean time: 3.4158377170562746
Pipeline stage StressChecker completed in 37.73s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_kiguk_2025-05-23 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3460.43s
Shutdown handler de-registered
function_kiguk_2025-05-23 status is now inactive due to auto deactivation removed underperforming models
function_kiguk_2025-05-23 status is now torndown due to DeploymentManager action