submission_id: function_nilem_2024-10-29
developer_uid: valentin
celo_rating: 1254.74
display_name: guard_ensemble_w0pt1_bo2
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: guard_ensemble_w0pt1_bo2
num_battles: 9728
num_wins: 5110
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-29T14:10:48+00:00
us_pacific_date: 2024-10-29
win_ratio: 0.5252878289473685
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.380188941955566s
Received healthy response to inference request in 5.47183895111084s
Received healthy response to inference request in 4.370360851287842s
Received healthy response to inference request in 5.0140838623046875s
Received healthy response to inference request in 6.29480504989624s
5 requests
0 failed requests
5th percentile: 4.499105453491211
10th percentile: 4.62785005569458
20th percentile: 4.885339260101318
30th percentile: 5.087304878234863
40th percentile: 5.233746910095215
50th percentile: 5.380188941955566
60th percentile: 5.416848945617676
70th percentile: 5.453508949279785
80th percentile: 5.63643217086792
90th percentile: 5.96561861038208
95th percentile: 6.13021183013916
99th percentile: 6.261886405944824
mean time: 5.306255531311035
Pipeline stage StressChecker completed in 30.09s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.27s
Shutdown handler de-registered
function_nilem_2024-10-29 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 2, running shutdown handler
Shutdown handler de-registered