developer_uid: azuruce
submission_id: function_lisib_2024-10-27
model_name: select-most-safe
model_group:
status: torndown
timestamp: 2024-10-27T03:18:58+00:00
num_battles: 19
num_wins: 11
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: select-most-safe
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-26
win_ratio: 0.5789473684210527
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.425945997238159s
Received healthy response to inference request in 3.730177879333496s
Received healthy response to inference request in 4.665965795516968s
Received healthy response to inference request in 4.0319130420684814s
Received healthy response to inference request in 3.3693203926086426s
5 requests
0 failed requests
5th percentile: 3.441491889953613
10th percentile: 3.513663387298584
20th percentile: 3.6580063819885256
30th percentile: 3.7905249118804933
40th percentile: 3.9112189769744874
50th percentile: 4.0319130420684814
60th percentile: 4.189526224136353
70th percentile: 4.3471394062042235
80th percentile: 4.473949956893921
90th percentile: 4.569957876205445
95th percentile: 4.617961835861206
99th percentile: 4.656365003585815
mean time: 4.044664621353149
Pipeline stage StressChecker completed in 22.31s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.92s
Shutdown handler de-registered
function_lisib_2024-10-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
function_lisib_2024-10-27 status is now torndown due to DeploymentManager action