submission_id: function_sotuk_2024-10-13
developer_uid: chai_backend_admin
celo_rating: 1205.29
display_name: retune_with_base
family_friendly_score: 0.5900875190258752
family_friendly_standard_error: 0.006770470675098869
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 5565
num_wins: 2516
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-13T22:33:28+00:00
us_pacific_date: 2024-10-13
win_ratio: 0.4521114106019766
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.911400318145752s
Received healthy response to inference request in 2.0351481437683105s
Received healthy response to inference request in 2.170752763748169s
Received healthy response to inference request in 2.110630750656128s
Received healthy response to inference request in 2.486091136932373s
5 requests
0 failed requests
5th percentile: 1.9361498832702637
10th percentile: 1.9608994483947755
20th percentile: 2.010398578643799
30th percentile: 2.050244665145874
40th percentile: 2.080437707901001
50th percentile: 2.110630750656128
60th percentile: 2.1346795558929443
70th percentile: 2.1587283611297607
80th percentile: 2.2338204383850098
90th percentile: 2.3599557876586914
95th percentile: 2.4230234622955322
99th percentile: 2.473477602005005
mean time: 2.1428046226501465
Pipeline stage StressChecker completed in 13.25s
Shutdown handler de-registered
function_sotuk_2024-10-13 status is now deployed due to DeploymentManager action
function_sotuk_2024-10-13 status is now torndown due to DeploymentManager action