submission_id: function_degak_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1259.86
display_name: retune_with_base
family_friendly_score: 0.5631136044880786
family_friendly_standard_error: 0.009279379503992406
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 2921
num_wins: 1531
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T17:28:44+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.5241355700102704
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.980833053588867s
Received healthy response to inference request in 3.3342909812927246s
Received healthy response to inference request in 4.260919094085693s
Received healthy response to inference request in 3.020226001739502s
Received healthy response to inference request in 1.75315260887146s
5 requests
0 failed requests
5th percentile: 2.006567287445068
10th percentile: 2.259981966018677
20th percentile: 2.7668113231658937
30th percentile: 3.0830389976501467
40th percentile: 3.2086649894714356
50th percentile: 3.3342909812927246
60th percentile: 3.704942226409912
70th percentile: 4.0755934715271
80th percentile: 4.604901885986329
90th percentile: 5.2928674697875975
95th percentile: 5.636850261688232
99th percentile: 5.91203649520874
mean time: 3.6698843479156493
Pipeline stage StressChecker completed in 20.15s
Shutdown handler de-registered
function_degak_2024-09-26 status is now deployed due to DeploymentManager action
function_degak_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 43.68s
Service chaiml-0926-nemo-virgo-t-3956-v6 has been torndown
Tearing down inference service chaiml-0926-nemo-virgo-t-3956-v7
Checking if service chaiml-0926-nemo-virgo-t-5421-v1 is running
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 25.31s
Pipeline stage %s skipped, reason=%s
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLDeleter
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
Pipeline stage %s skipped, reason=%s
run pipeline %s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 71.55s
Waiting for inference service blend-rofur-2024-10-03 to be ready
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fuhof_2024-09-27
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
run pipeline %s
%s, retrying in %s seconds...
Tearing down inference service blend-rofur-2024-10-03
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fuhof_2024-09-27
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLDeleter completed in 94.59s
Pipeline stage %s skipped, reason=%s
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 27.11s
Pipeline stage %s skipped, reason=%s
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
Pipeline stage %s skipped, reason=%s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 3.73s
admin requested tearing down of function_jisob_2024-09-26
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
run pipeline %s
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 4.14s
Running pipeline stage MKMLModelDeleter
Pipeline stage MKMLModelDeleter completed in 4.18s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
Pipeline stage %s skipped, reason=%s
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline stage %s
Shutdown handler de-registered