developer_uid: chai_backend_admin
submission_id: function_kepan_2024-10-13
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-13T22:32:21+00:00
num_battles: 5547
num_wins: 3114
celo_rating: 1274.86
family_friendly_score: 0.5856472676556359
family_friendly_standard_error: 0.006774285791874039
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-13
win_ratio: 0.5613845321795565
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.329221725463867s
Received healthy response to inference request in 2.0107319355010986s
Received healthy response to inference request in 1.3811719417572021s
Received healthy response to inference request in 1.9959921836853027s
Received healthy response to inference request in 2.531737804412842s
5 requests
0 failed requests
5th percentile: 1.5041359901428222
10th percentile: 1.6271000385284424
20th percentile: 1.8730281352996827
30th percentile: 1.9989401340484618
40th percentile: 2.0048360347747805
50th percentile: 2.0107319355010986
60th percentile: 2.138127851486206
70th percentile: 2.2655237674713136
80th percentile: 2.3697249412536623
90th percentile: 2.450731372833252
95th percentile: 2.4912345886230467
99th percentile: 2.5236371612548827
mean time: 2.0497711181640623
Pipeline stage StressChecker completed in 12.78s
Shutdown handler de-registered
function_kepan_2024-10-13 status is now deployed due to DeploymentManager action
function_kepan_2024-10-13 status is now torndown due to DeploymentManager action