developer_uid: azuruce
submission_id: function_gisab_2024-10-27
model_name: select-most-safe
model_group:
status: torndown
timestamp: 2024-10-27T07:20:00+00:00
num_battles: 42
num_wins: 21
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: select-most-safe
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-27
win_ratio: 0.5
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.755383014678955s
Received healthy response to inference request in 4.564669132232666s
Received healthy response to inference request in 2.8861289024353027s
Received healthy response to inference request in 3.3629961013793945s
Received healthy response to inference request in 3.361501932144165s
5 requests
0 failed requests
5th percentile: 2.9812035083770754
10th percentile: 3.0762781143188476
20th percentile: 3.2664273262023924
30th percentile: 3.361800765991211
40th percentile: 3.3623984336853026
50th percentile: 3.3629961013793945
60th percentile: 3.5199508666992188
70th percentile: 3.676905632019043
80th percentile: 3.9172402381896974
90th percentile: 4.2409546852111815
95th percentile: 4.402811908721923
99th percentile: 4.532297687530518
mean time: 3.586135816574097
Pipeline stage StressChecker completed in 19.86s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.10s
Shutdown handler de-registered
function_gisab_2024-10-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
function_gisab_2024-10-27 status is now torndown due to DeploymentManager action