developer_uid: jxlu90
submission_id: function_salil_2024-12-27
model_name: llama_405b_bo4
model_group:
status: torndown
timestamp: 2024-12-27T18:53:03+00:00
num_battles: 18933
num_wins: 9273
celo_rating: 1253.89
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: llama_405b_bo4
is_internal_developer: False
ranking_group: single
us_pacific_date: 2024-12-27
win_ratio: 0.48977974964347964
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:', '</s>'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.027818202972412s
Received healthy response to inference request in 3.97780179977417s
Received healthy response to inference request in 3.0981574058532715s
Received healthy response to inference request in 2.9050052165985107s
Received healthy response to inference request in 2.8236114978790283s
5 requests
0 failed requests
5th percentile: 2.839890241622925
10th percentile: 2.8561689853668213
20th percentile: 2.8887264728546143
30th percentile: 2.929567813873291
40th percentile: 2.9786930084228516
50th percentile: 3.027818202972412
60th percentile: 3.0559538841247558
70th percentile: 3.0840895652770994
80th percentile: 3.2740862846374514
90th percentile: 3.6259440422058105
95th percentile: 3.80187292098999
99th percentile: 3.942616024017334
mean time: 3.1664788246154787
Pipeline stage StressChecker completed in 16.81s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
function_salil_2024-12-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_salil_2024-12-27 status is now inactive due to auto deactivation removed underperforming models
function_salil_2024-12-27 status is now torndown due to DeploymentManager action
function_salil_2024-12-27 status is now torndown due to DeploymentManager action
function_salil_2024-12-27 status is now torndown due to DeploymentManager action