developer_uid: jxlu90
submission_id: function_hegal_2024-12-31
model_name: llama_405b_bo4_ctx1k
model_group:
status: torndown
timestamp: 2024-12-31T20:06:07+00:00
num_battles: 4165
num_wins: 2113
celo_rating: 1275.22
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: llama_405b_bo4_ctx1k
is_internal_developer: False
ranking_group: single
us_pacific_date: 2024-12-31
win_ratio: 0.5073229291716687
generation_params: {'temperature': 0.9, 'top_p': 0.95, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.0, 'frequency_penalty': 0.1, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1151068210601807s
Received healthy response to inference request in 4.376948833465576s
Received healthy response to inference request in 2.9297547340393066s
Received healthy response to inference request in 3.6647558212280273s
Received healthy response to inference request in 3.019334077835083s
5 requests
0 failed requests
5th percentile: 2.947670602798462
10th percentile: 2.965586471557617
20th percentile: 3.001418209075928
30th percentile: 3.0384886264801025
40th percentile: 3.0767977237701416
50th percentile: 3.1151068210601807
60th percentile: 3.3349664211273193
70th percentile: 3.554826021194458
80th percentile: 3.8071944236755373
90th percentile: 4.092071628570556
95th percentile: 4.234510231018066
99th percentile: 4.348461112976074
mean time: 3.4211800575256346
Pipeline stage StressChecker completed in 18.27s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_hegal_2024-12-31 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_hegal_2024-12-31 status is now inactive due to admin request
function_hegal_2024-12-31 status is now torndown due to DeploymentManager action
function_hegal_2024-12-31 status is now torndown due to DeploymentManager action
function_hegal_2024-12-31 status is now torndown due to DeploymentManager action