function_fafot_2024-09-26

submission_id: function_fafot_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1204.07
display_name: retune_with_base
family_friendly_score: 0.6173139158576052
family_friendly_standard_error: 0.008719618032110221
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3158
num_wins: 1412
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T17:47:05+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.44711842938568713
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.1324989795684814s
Received healthy response to inference request in 2.8939146995544434s
Received healthy response to inference request in 2.8362412452697754s
Received healthy response to inference request in 3.449730157852173s
Received healthy response to inference request in 4.285969257354736s
5 requests
0 failed requests
5th percentile: 2.847775936126709
10th percentile: 2.8593106269836426
20th percentile: 2.8823800086975098
30th percentile: 2.941631555557251
40th percentile: 3.037065267562866
50th percentile: 3.1324989795684814
60th percentile: 3.259391450881958
70th percentile: 3.3862839221954344
80th percentile: 3.616977977752686
90th percentile: 3.951473617553711
95th percentile: 4.118721437454224
99th percentile: 4.252519693374634
mean time: 3.319670867919922
Pipeline stage StressChecker completed in 36.37s
Shutdown handler de-registered
function_fafot_2024-09-26 status is now deployed due to DeploymentManager action
function_fafot_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_keneb_2024-09-26
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 50.31s
Service chaiml-0926-nemo-virgo-t-3956-v7 has been torndown
Tearing down inference service chaiml-0926-nemo-virgo-t-5421-v1
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_keneb_2024-09-26
Pipeline stage MKMLModelDeleter completed in 28.95s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 28.49s
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Shutdown handler de-registered
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
Pipeline stage MKMLDeleter completed in 90.38s
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_sulib_2024-09-26
Shutdown handler de-registered
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 99.89s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Pipeline stage MKMLDeleter completed in 30.27s
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_fafot_2024-09-26
admin requested tearing down of blend_dones_2024-09-27
admin requested tearing down of blend_dones_2024-09-27
Pipeline stage MKMLDeleter completed in 42.17s
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_femik_2024-09-26
Shutdown handler not registered because Python interpreter is not running in the main thread
Tearing down inference service blend-rofur-2024-10-03
admin requested tearing down of blend_fenik_2024-09-27
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 66.76s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
run pipeline %s
%s, retrying in %s seconds...
Tearing down inference service blend-rofur-2024-10-03
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fuhof_2024-09-27
run pipeline %s
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLDeleter completed in 94.59s
Pipeline stage %s skipped, reason=%s
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
admin requested tearing down of function_keneb_2024-09-26
Creating inference service blend-rofur-2024-10-03
%s, retrying in %s seconds...
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler de-registered
admin requested tearing down of function_keneb_2024-09-26
Creating inference service blend-rofur-2024-10-03
Running pipeline stage MKMLModelDeleter
%s, retrying in %s seconds...
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of blend_fulat_2024-09-27
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLModelDeleter completed in 104.24s
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 98.75s
Shutdown handler de-registered
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_keneb_2024-09-26
Pipeline stage MKMLModelDeleter completed in 30.98s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 31.26s
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline stage %s
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 2.88s
run pipeline %s
Pipeline stage %s skipped, reason=%s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_fafot_2024-09-26
Running pipeline stage MKMLDeleter
run pipeline stage %s
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 2.76s
run pipeline %s
Pipeline stage %s skipped, reason=%s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_femik_2024-09-26
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
Running pipeline stage MKMLDeleter
run pipeline stage %s
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 3.32s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_jisob_2024-09-26
Pipeline stage MKMLDeleter completed in 4.53s
Pipeline stage %s skipped, reason=%s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler de-registered
run pipeline %s
run pipeline stage %s
Pipeline stage MKMLModelDeleter completed in 4.70s
Pipeline stage MKMLDeleter completed in 4.81s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_keneb_2024-09-26
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
Running pipeline stage MKMLDeleter
run pipeline stage %s
Running pipeline stage MKMLModelDeleter
Pipeline stage MKMLDeleter completed in 2.33s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_fafot_2024-09-26
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
run pipeline stage %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 3.29s
admin requested tearing down of function_femik_2024-09-26
Pipeline stage %s skipped, reason=%s
Pipeline stage MKMLModelDeleter completed in 3.64s
Running pipeline stage MKMLModelDeleter
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 3.73s
admin requested tearing down of function_jisob_2024-09-26
Shutdown handler de-registered
Pipeline stage %s skipped, reason=%s
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
run pipeline %s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_keneb_2024-09-26
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_keneb_2024-09-26
Pipeline stage MKMLDeleter completed in 5.10s
Pipeline stage %s skipped, reason=%s
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
run pipeline %s
Pipeline stage %s skipped, reason=%s
Shutdown handler not registered because Python interpreter is not running in the main thread
Running pipeline stage MKMLDeleter
Pipeline stage MKMLDeleter completed in 2.33s
admin requested tearing down of function_fafot_2024-09-26
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLModelDeleter completed in 2.83s
run pipeline %s
Pipeline stage %s skipped, reason=%s
run pipeline stage %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_femik_2024-09-26
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLDeleter
Shutdown handler de-registered
Shutdown handler de-registered
Pipeline stage MKMLDeleter completed in 4.14s
Running pipeline stage MKMLModelDeleter
run pipeline %s
admin requested tearing down of function_jisob_2024-09-26
Pipeline stage %s skipped, reason=%s
chaiml-0916-intent-suppo_6584_v5 status is now torndown due to DeploymentManager action
function_degak_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline stage %s
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
Shutdown handler not registered because Python interpreter is not running in the main thread
Pipeline stage MKMLDeleter completed in 4.18s
admin requested tearing down of function_keneb_2024-09-26
Running pipeline stage MKMLModelDeleter
chaiml-0926-nemo-virgo-t_1582_v1 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
function_fafot_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline stage %s