submission_id: function_hemim_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1249.39
display_name: retune_with_base
family_friendly_score: 0.5784006272050176
family_friendly_standard_error: 0.009765231163309396
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 2642
num_wins: 1341
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T17:13:43+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.5075700227100681
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.890475273132324s
Received healthy response to inference request in 2.0036892890930176s
Received healthy response to inference request in 2.519286632537842s
Received healthy response to inference request in 2.3108463287353516s
Received healthy response to inference request in 2.284167766571045s
5 requests
0 failed requests
5th percentile: 2.059784984588623
10th percentile: 2.1158806800842287
20th percentile: 2.2280720710754394
30th percentile: 2.289503479003906
40th percentile: 2.300174903869629
50th percentile: 2.3108463287353516
60th percentile: 2.394222450256348
70th percentile: 2.4775985717773437
80th percentile: 2.593524360656738
90th percentile: 2.7419998168945314
95th percentile: 2.816237545013428
99th percentile: 2.875627727508545
mean time: 2.401693058013916
Pipeline stage StressChecker completed in 13.87s
Shutdown handler de-registered
function_hemim_2024-09-26 status is now deployed due to DeploymentManager action
function_hemim_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rihet_2024-09-26
Pipeline stage MKMLModelDeleter completed in 38.84s
Pipeline stage %s skipped, reason=%s
Ignoring service blend-rofur-2024-10-03 already deployed
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_hemim_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rihet_2024-09-26
chaiml-0916-intent-suppo_6584_v3 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 45.17s
Waiting for inference service blend-rofur-2024-10-03 to be ready
Cleaning model data from S3
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLModelDeleter completed in 44.84s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_hemim_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rihet_2024-09-26
chaiml-0916-intent-suppo_6584_v3 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 34.85s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Waiting for inference service blend-rofur-2024-10-03 to be ready
function_hemim_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rihet_2024-09-26
Ignoring service blend-rofur-2024-10-03 already deployed
Cleaning model data from S3
Pipeline stage MKMLModelDeleter completed in 38.74s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_hemim_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rihet_2024-09-26
Running pipeline stage MKMLModelDeleter
Creating inference service blend-rofur-2024-10-03
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 57.19s
Skipping teardown as no inference service was successfully deployed
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 76.14s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_hemim_2024-09-26 status is now torndown due to DeploymentManager action
function_harol_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rihet_2024-09-26
chaiml-0916-intent-suppo_6584_v3 status is now torndown due to DeploymentManager action
Ignoring service blend-rofur-2024-10-03 already deployed
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
function_hemim_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rihet_2024-09-26
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 37.03s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_hemim_2024-09-26 status is now torndown due to DeploymentManager action