submission_id: function_mijan_2024-10-13
developer_uid: chai_backend_admin
celo_rating: 1208.69
display_name: retune_with_base
family_friendly_score: 0.593190257754478
family_friendly_standard_error: 0.006260134141813978
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.75, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '\n\n', '\nYou:', '[/INST]', '<|im_end|>', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 6545
num_wins: 2942
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-10-13T22:31:14+00:00
us_pacific_date: 2024-10-13
win_ratio: 0.44950343773873186
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.3253021240234375s
Received healthy response to inference request in 1.9997079372406006s
Received healthy response to inference request in 1.384894847869873s
Received healthy response to inference request in 1.3701419830322266s
Received healthy response to inference request in 1.3932201862335205s
5 requests
0 failed requests
5th percentile: 1.3342700958251954
10th percentile: 1.343238067626953
20th percentile: 1.3611740112304687
30th percentile: 1.3730925559997558
40th percentile: 1.3789937019348144
50th percentile: 1.384894847869873
60th percentile: 1.388224983215332
70th percentile: 1.391555118560791
80th percentile: 1.5145177364349367
90th percentile: 1.7571128368377686
95th percentile: 1.8784103870391844
99th percentile: 1.9754484272003174
mean time: 1.4946534156799316
Pipeline stage StressChecker completed in 9.99s
Shutdown handler de-registered
function_mijan_2024-10-13 status is now deployed due to DeploymentManager action
function_mijan_2024-10-13 status is now torndown due to DeploymentManager action