developer_uid: azuruce
submission_id: function_jafet_2024-10-28
model_name: select-unsafe
model_group:
status: torndown
timestamp: 2024-10-28T05:39:12+00:00
num_battles: 11458
num_wins: 5400
celo_rating: 1214.72
family_friendly_score: 0.5831999999999999
family_friendly_standard_error: 0.006972485353157796
submission_type: function
display_name: select-unsafe
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-27
win_ratio: 0.47128643742363413
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.725538969039917s
Received healthy response to inference request in 2.2476398944854736s
Received healthy response to inference request in 4.064997673034668s
Received healthy response to inference request in 2.3668861389160156s
Received healthy response to inference request in 3.3219010829925537s
5 requests
0 failed requests
5th percentile: 2.271489143371582
10th percentile: 2.2953383922576904
20th percentile: 2.3430368900299072
30th percentile: 2.557889127731323
40th percentile: 2.9398951053619387
50th percentile: 3.3219010829925537
60th percentile: 3.483356237411499
70th percentile: 3.6448113918304443
80th percentile: 3.793430709838867
90th percentile: 3.9292141914367678
95th percentile: 3.997105932235718
99th percentile: 4.051419324874878
mean time: 3.1453927516937257
Pipeline stage StressChecker completed in 17.58s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 6.67s
Shutdown handler de-registered
function_jafet_2024-10-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2775.99s
Shutdown handler de-registered
function_jafet_2024-10-28 status is now inactive due to auto deactivation removed underperforming models
function_jafet_2024-10-28 status is now torndown due to DeploymentManager action