submission_id: function_kepan_2024-10-13
developer_uid: chai_backend_admin
celo_rating: 1274.86
display_name: retune_with_base
family_friendly_score: 0.5856472676556359
family_friendly_standard_error: 0.006774285791874039
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 5547
num_wins: 3114
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-13T22:32:21+00:00
us_pacific_date: 2024-10-13
win_ratio: 0.5613845321795565
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.329221725463867s
Received healthy response to inference request in 2.0107319355010986s
Received healthy response to inference request in 1.3811719417572021s
Received healthy response to inference request in 1.9959921836853027s
Received healthy response to inference request in 2.531737804412842s
5 requests
0 failed requests
5th percentile: 1.5041359901428222
10th percentile: 1.6271000385284424
20th percentile: 1.8730281352996827
30th percentile: 1.9989401340484618
40th percentile: 2.0048360347747805
50th percentile: 2.0107319355010986
60th percentile: 2.138127851486206
70th percentile: 2.2655237674713136
80th percentile: 2.3697249412536623
90th percentile: 2.450731372833252
95th percentile: 2.4912345886230467
99th percentile: 2.5236371612548827
mean time: 2.0497711181640623
Pipeline stage StressChecker completed in 12.78s
Shutdown handler de-registered
function_kepan_2024-10-13 status is now deployed due to DeploymentManager action
function_kepan_2024-10-13 status is now torndown due to DeploymentManager action