developer_uid: chai_backend_admin
submission_id: function_sekob_2025-04-23
model_name: function_sekob_2025-04-23
model_group:
status: torndown
timestamp: 2025-04-23T18:02:01+00:00
num_battles: 8320
num_wins: 4207
celo_rating: 1291.5
family_friendly_score: 0.5296000000000001
family_friendly_standard_error: 0.007058666162951752
submission_type: function
display_name: function_sekob_2025-04-23
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-23
win_ratio: 0.5056490384615384
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.9517881870269775s
Received healthy response to inference request in 3.1642234325408936s
Received healthy response to inference request in 4.619633197784424s
Received healthy response to inference request in 3.9275009632110596s
Received healthy response to inference request in 3.8150551319122314s
5 requests
0 failed requests
5th percentile: 3.294389772415161
10th percentile: 3.424556112289429
20th percentile: 3.684888792037964
30th percentile: 3.837544298171997
40th percentile: 3.882522630691528
50th percentile: 3.9275009632110596
60th percentile: 3.9372158527374266
70th percentile: 3.946930742263794
80th percentile: 4.085357189178467
90th percentile: 4.352495193481445
95th percentile: 4.486064195632935
99th percentile: 4.592919397354126
mean time: 3.895640182495117
%s, retrying in %s seconds...
Received healthy response to inference request in 3.453291893005371s
Received healthy response to inference request in 3.0499582290649414s
Received healthy response to inference request in 2.1237101554870605s
Received healthy response to inference request in 2.4049601554870605s
Received healthy response to inference request in 4.381108999252319s
5 requests
0 failed requests
5th percentile: 2.1799601554870605
10th percentile: 2.2362101554870604
20th percentile: 2.3487101554870606
30th percentile: 2.5339597702026366
40th percentile: 2.7919589996337892
50th percentile: 3.0499582290649414
60th percentile: 3.211291694641113
70th percentile: 3.372625160217285
80th percentile: 3.638855314254761
90th percentile: 4.00998215675354
95th percentile: 4.195545578002929
99th percentile: 4.343996315002442
mean time: 3.0826058864593504
Pipeline stage StressChecker completed in 37.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.93s
Shutdown handler de-registered
function_sekob_2025-04-23 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3163.13s
Shutdown handler de-registered
function_sekob_2025-04-23 status is now inactive due to auto deactivation removed underperforming models
function_sekob_2025-04-23 status is now torndown due to DeploymentManager action