developer_uid: chai_backend_admin
submission_id: function_sumam_2025-05-03
model_name: function_sumam_2025-05-03
model_group:
status: torndown
timestamp: 2025-05-03T05:35:24+00:00
num_battles: 7739
num_wins: 3907
celo_rating: 1287.97
family_friendly_score: 0.5286
family_friendly_standard_error: 0.007059490633183105
submission_type: function
display_name: function_sumam_2025-05-03
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-02
win_ratio: 0.5048455872851789
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.974070310592651s
Received healthy response to inference request in 2.576233386993408s
Received healthy response to inference request in 2.7969343662261963s
Received healthy response to inference request in 3.58487868309021s
Received healthy response to inference request in 2.5300917625427246s
5 requests
0 failed requests
5th percentile: 2.5393200874328614
10th percentile: 2.5485484123229982
20th percentile: 2.5670050621032714
30th percentile: 2.620373582839966
40th percentile: 2.708653974533081
50th percentile: 2.7969343662261963
60th percentile: 3.1121120929718016
70th percentile: 3.427289819717407
80th percentile: 3.8627170085906983
90th percentile: 4.418393659591675
95th percentile: 4.6962319850921626
99th percentile: 4.918502645492554
mean time: 3.292441701889038
Pipeline stage StressChecker completed in 17.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_sumam_2025-05-03 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3356.96s
Shutdown handler de-registered
function_sumam_2025-05-03 status is now inactive due to auto deactivation removed underperforming models
function_sumam_2025-05-03 status is now torndown due to DeploymentManager action