function_pihil_2024-10-28

developer_uid: azuruce

submission_id: function_pihil_2024-10-28

model_name: select-safe

model_group:

status: torndown

timestamp: 2024-10-28T05:31:58+00:00

num_battles: 0

num_wins: 0

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: select-safe

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-10-27

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.827311992645264s
Received healthy response to inference request in 5.401025772094727s
Received healthy response to inference request in 3.9552738666534424s
Received healthy response to inference request in 5.825894832611084s
Received healthy response to inference request in 6.279850006103516s
5 requests
0 failed requests
5th percentile: 4.2444242477417
10th percentile: 4.533574628829956
20th percentile: 5.111875391006469
30th percentile: 5.485999584197998
40th percentile: 5.655947208404541
50th percentile: 5.825894832611084
60th percentile: 5.826461696624756
70th percentile: 5.827028560638428
80th percentile: 5.917819595336914
90th percentile: 6.098834800720215
95th percentile: 6.189342403411866
99th percentile: 6.261748485565185
mean time: 5.457871294021606
Pipeline stage StressChecker completed in 29.23s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.03s
Shutdown handler de-registered
function_pihil_2024-10-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Received signal 15, running shutdown handler
Received signal 15, running shutdown handler
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Received signal 15, running shutdown handler
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
function_pihil_2024-10-28 status is now torndown due to DeploymentManager action