submission_id: function_kulof_2024-10-19
developer_uid: chai_backend_admin
celo_rating: 1196.97
display_name: llama70b-bo4
family_friendly_score: 0.6160002713059992
family_friendly_standard_error: 0.004882332877814735
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: llama70b-bo4
num_battles: 1595614
num_wins: 677755
ranking_group: single
status: deployed
submission_type: function
timestamp: 2024-10-19T18:31:44+00:00
us_pacific_date: 2024-10-19
win_ratio: 0.4247612517814459
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8117790222167969s
Received healthy response to inference request in 2.015840530395508s
Received healthy response to inference request in 1.8350260257720947s
Received healthy response to inference request in 1.8218445777893066s
Received healthy response to inference request in 1.9348466396331787s
5 requests
0 failed requests
5th percentile: 1.8137921333312987
10th percentile: 1.8158052444458008
20th percentile: 1.8198314666748048
30th percentile: 1.8244808673858643
40th percentile: 1.8297534465789795
50th percentile: 1.8350260257720947
60th percentile: 1.8749542713165284
70th percentile: 1.914882516860962
80th percentile: 1.9510454177856444
90th percentile: 1.9834429740905761
95th percentile: 1.999641752243042
99th percentile: 2.0126007747650148
mean time: 1.883867359161377
Pipeline stage StressChecker completed in 10.82s
Shutdown handler de-registered
function_kulof_2024-10-19 status is now deployed due to DeploymentManager action