submission_id: function_rihet_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1259.1
display_name: retune_with_base
family_friendly_score: 0.5882647943831494
family_friendly_standard_error: 0.008983260187090558
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 3079
num_wins: 1606
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T17:25:09+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.5215979214030529
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.912855386734009s
Received healthy response to inference request in 3.4938201904296875s
Received healthy response to inference request in 3.401887893676758s
Received healthy response to inference request in 3.3045146465301514s
Received healthy response to inference request in 3.4019906520843506s
5 requests
0 failed requests
5th percentile: 3.3239892959594726
10th percentile: 3.3434639453887938
20th percentile: 3.3824132442474366
30th percentile: 3.401908445358276
40th percentile: 3.4019495487213134
50th percentile: 3.4019906520843506
60th percentile: 3.4387224674224854
70th percentile: 3.4754542827606203
80th percentile: 3.9776272296905524
90th percentile: 4.945241308212281
95th percentile: 5.429048347473144
99th percentile: 5.8160939788818355
mean time: 3.903013753890991
Pipeline stage StressChecker completed in 21.33s
Shutdown handler de-registered
function_rihet_2024-09-26 status is now deployed due to DeploymentManager action
function_rihet_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v2
chaiml-albert-dpo-0912-v_1751_v2 status is now torndown due to DeploymentManager action
Cleaning model data from model cache
Deleting key chaiml-albert-dpo-0912-v-8296-v2/config.json from bucket guanaco-mkml-models
function_rihet_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v2
Deleting key nousresearch-meta-llama-4939-v67/config.json from bucket guanaco-mkml-models
Cleaning model data from model cache
Deleting key nousresearch-meta-llama-4939-v66/flywheel_model.0.safetensors from bucket guanaco-mkml-models
chaiml-albert-dpo-0912-v_1751_v2 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 38.80s
function_rihet_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v2
chaiml-albert-dpo-0912-v_1751_v2 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 29.39s
function_rihet_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v2
Deleting key nousresearch-meta-llama-4939-v71/flywheel_model.0.safetensors from bucket guanaco-mkml-models
chaiml-albert-dpo-0912-v_1751_v2 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 33.99s
function_rihet_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v2
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 60.27s
Skipping deletion as no model was successfully uploaded
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 60.42s
chaiml-albert-dpo-0912-v_1751_v2 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 58.60s
function_rihet_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
Creating inference service blend-rofur-2024-10-03
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 50.51s
Shutdown handler de-registered
function_harol_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_rihet_2024-09-26
Pipeline stage MKMLModelDeleter completed in 50.69s
chaiml-0916-intent-suppo_6584_v3 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 50.69s
chaiml-0916-intent-suppo_6584_v3 status is now torndown due to DeploymentManager action
Ignoring service blend-rofur-2024-10-03 already deployed
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
function_hemim_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of function_todun_2024-09-26
Shutdown handler de-registered
Waiting for inference service blend-rofur-2024-10-03 to be ready
Pipeline stage MKMLModelDeleter completed in 54.74s
Pipeline stage %s skipped, reason=%s
Running pipeline stage MKMLModelDeleter
function_kumam_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v1
chaiml-0917-bot-dominant_6324_v5 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 44.66s
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v2
chaiml-albert-dpo-0912-v_1751_v2 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 44.29s
function_rihet_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v2
chaiml-albert-dpo-0912-v_1751_v2 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 31.30s
function_rihet_2024-09-26 status is now torndown due to DeploymentManager action