developer_uid: chai_backend_admin
submission_id: function_semir_2024-11-14
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-11-14T19:37:52+00:00
num_battles: 7650
num_wins: 3900
celo_rating: 1253.91
family_friendly_score: 0.5992
family_friendly_standard_error: 0.0069305030120475385
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-14
win_ratio: 0.5098039215686274
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1342194080352783s
Received healthy response to inference request in 3.245493173599243s
Received healthy response to inference request in 1.9131898880004883s
Received healthy response to inference request in 2.0371382236480713s
Received healthy response to inference request in 2.251824378967285s
5 requests
0 failed requests
5th percentile: 1.937979555130005
10th percentile: 1.9627692222595214
20th percentile: 2.0123485565185546
30th percentile: 2.0800754547119142
40th percentile: 2.1659499168395997
50th percentile: 2.251824378967285
60th percentile: 2.6047823905944822
70th percentile: 2.9577404022216793
80th percentile: 3.156474161148071
90th percentile: 3.200983667373657
95th percentile: 3.2232384204864504
99th percentile: 3.2410422229766844
mean time: 2.5163730144500733
Pipeline stage StressChecker completed in 13.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.55s
Shutdown handler de-registered
function_semir_2024-11-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2716.51s
Shutdown handler de-registered
function_semir_2024-11-14 status is now inactive due to auto deactivation removed underperforming models
function_semir_2024-11-14 status is now torndown due to DeploymentManager action