developer_uid: chai_backend_admin
submission_id: function_pebof_2024-11-14
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-11-14T21:28:10+00:00
num_battles: 7519
num_wins: 4103
celo_rating: 1284.07
family_friendly_score: 0.5846
family_friendly_standard_error: 0.006969115295358515
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-14
win_ratio: 0.5456842665248038
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3671257495880127s
Received healthy response to inference request in 2.318028450012207s
Received healthy response to inference request in 2.4616198539733887s
Received healthy response to inference request in 2.369966983795166s
Received healthy response to inference request in 3.8009023666381836s
5 requests
0 failed requests
5th percentile: 2.3284161567687987
10th percentile: 2.3388038635253907
20th percentile: 2.3595792770385744
30th percentile: 2.3882975578308105
40th percentile: 2.4249587059020996
50th percentile: 2.4616198539733887
60th percentile: 2.823822212219238
70th percentile: 3.186024570465088
80th percentile: 3.453881072998047
90th percentile: 3.627391719818115
95th percentile: 3.714147043228149
99th percentile: 3.7835513019561766
mean time: 2.863528680801392
Pipeline stage StressChecker completed in 15.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.21s
Shutdown handler de-registered
function_pebof_2024-11-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Retrying (%r) after connection broken by '%r': %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 3174.19s
Shutdown handler de-registered
function_pebof_2024-11-14 status is now inactive due to auto deactivation removed underperforming models
function_pebof_2024-11-14 status is now torndown due to DeploymentManager action