submission_id: function_fogul_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1249.06
display_name: retune_with_base
family_friendly_score: 0.5818965517241379
family_friendly_standard_error: 0.009985200928772841
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 2548
num_wins: 1281
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T17:11:50+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.5027472527472527
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.10140061378479s
Received healthy response to inference request in 1.868506908416748s
Received healthy response to inference request in 1.6780331134796143s
Received healthy response to inference request in 1.8573296070098877s
Received healthy response to inference request in 1.7620553970336914s
5 requests
0 failed requests
5th percentile: 1.6948375701904297
10th percentile: 1.7116420269012451
20th percentile: 1.745250940322876
30th percentile: 1.7811102390289306
40th percentile: 1.8192199230194093
50th percentile: 1.8573296070098877
60th percentile: 1.861800527572632
70th percentile: 1.866271448135376
80th percentile: 1.9150856494903565
90th percentile: 2.008243131637573
95th percentile: 2.0548218727111816
99th percentile: 2.0920848655700683
mean time: 1.8534651279449463
Pipeline stage StressChecker completed in 12.29s
Shutdown handler de-registered
function_fogul_2024-09-26 status is now deployed due to DeploymentManager action
function_fogul_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_kumam_2024-09-26
Running pipeline stage MKMLModelDeleter
chaiml-0916-intent-suppo_6584_v3 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLDeployer
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 32.35s
Pipeline stage %s skipped, reason=%s
function_fogul_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_kumam_2024-09-26
Pipeline stage MKMLModelDeleter completed in 37.72s
Running pipeline stage MKMLModelDeleter
Creating inference service blend-rofur-2024-10-03
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 39.38s
Skipping teardown as no inference service was successfully deployed
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 37.88s
Pipeline stage %s skipped, reason=%s
function_fogul_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Running pipeline stage MKMLDeployer
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_kumam_2024-09-26
Pipeline stage MKMLModelDeleter completed in 38.81s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 35.38s
Pipeline stage %s skipped, reason=%s
function_fogul_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_kumam_2024-09-26
Shutdown handler de-registered
Running pipeline stage MKMLDeployer
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 30.63s
Pipeline stage %s skipped, reason=%s
function_fogul_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_kumam_2024-09-26
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 44.97s
Skipping teardown as no inference service was successfully deployed
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_nikon_2024-10-04
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 47.01s
Pipeline stage %s skipped, reason=%s
function_fogul_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_kumam_2024-09-26
Running pipeline stage MKMLDeployer
Running pipeline stage MKMLModelDeleter
Pipeline stage MKMLModelDeleter completed in 48.05s
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 43.50s
Pipeline stage %s skipped, reason=%s
function_fogul_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_kumam_2024-09-26
Pipeline stage %s skipped, reason=%s
Ignoring service blend-rofur-2024-10-03 already deployed
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 30.81s
Pipeline stage %s skipped, reason=%s
function_fogul_2024-09-26 status is now torndown due to DeploymentManager action