function_kubuf_2024-10-28

developer_uid: azuruce

submission_id: function_kubuf_2024-10-28

model_name: select-safe

model_group:

status: torndown

timestamp: 2024-10-28T05:06:26+00:00

num_battles: 0

num_wins: 0

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: select-safe

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-10-27

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.404365062713623s
Received healthy response to inference request in 5.907684803009033s
Received healthy response to inference request in 5.493311882019043s
Received healthy response to inference request in 5.379562139511108s
Received healthy response to inference request in 5.536144018173218s
5 requests
0 failed requests
5th percentile: 5.402312088012695
10th percentile: 5.425062036514282
20th percentile: 5.470561933517456
30th percentile: 5.501878309249878
40th percentile: 5.519011163711548
50th percentile: 5.536144018173218
60th percentile: 5.684760332107544
70th percentile: 5.83337664604187
80th percentile: 6.0070208549499515
90th percentile: 6.205692958831787
95th percentile: 6.305029010772705
99th percentile: 6.384497852325439
mean time: 5.744213581085205
Pipeline stage StressChecker completed in 30.61s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 3.59s
Shutdown handler de-registered
function_kubuf_2024-10-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
function_kubuf_2024-10-28 status is now torndown due to DeploymentManager action