submission_id: function_pinen_2024-09-26
developer_uid: chai_backend_admin
celo_rating: 1250.05
display_name: retune_with_base
family_friendly_score: 0.5723547400611622
family_friendly_standard_error: 0.009456258459502646
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 2846
num_wins: 1438
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-26T17:05:12+00:00
us_pacific_date: 2024-09-26
win_ratio: 0.5052705551651441
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.515535831451416s
Received healthy response to inference request in 3.406093120574951s
Received healthy response to inference request in 3.107018232345581s
Received healthy response to inference request in 2.398991823196411s
Received healthy response to inference request in 3.6444127559661865s
5 requests
0 failed requests
5th percentile: 2.422300624847412
10th percentile: 2.445609426498413
20th percentile: 2.492227029800415
30th percentile: 2.633832311630249
40th percentile: 2.870425271987915
50th percentile: 3.107018232345581
60th percentile: 3.226648187637329
70th percentile: 3.346278142929077
80th percentile: 3.4537570476531982
90th percentile: 3.5490849018096924
95th percentile: 3.5967488288879395
99th percentile: 3.634879970550537
mean time: 3.0144103527069093
Pipeline stage StressChecker completed in 18.12s
Shutdown handler de-registered
function_pinen_2024-09-26 status is now deployed due to DeploymentManager action
function_pinen_2024-09-26 status is now inactive due to auto deactivation removed underperforming models
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v1
chaiml-0917-bot-dominant_6324_v5 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Cleaning model data from model cache
Cleaning model data from S3
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v1
nousresearch-meta-llama_4939_v64 status is now torndown due to DeploymentManager action
Cleaning model data from model cache
Cleaning model data from S3
Deleting key nousresearch-meta-llama-4939-v66/config.json from bucket guanaco-mkml-models
chaiml-0917-bot-dominant_6324_v5 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 45.53s
Pipeline stage %s skipped, reason=%s
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v1
chaiml-0917-bot-dominant_6324_v5 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 32.29s
Pipeline stage %s skipped, reason=%s
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v1
chaiml-0917-bot-dominant_6324_v5 status is now torndown due to DeploymentManager action
Deleting key nousresearch-meta-llama-4939-v71/config.json from bucket guanaco-mkml-models
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 37.95s
Pipeline stage %s skipped, reason=%s
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v1
Pipeline stage MKMLModelDeleter completed in 76.04s
Skipping deletion as no model was successfully uploaded
Running pipeline stage MKMLModelDeleter
run pipeline stage %s
Pipeline stage MKMLDeleter completed in 76.36s
Skipping teardown as no inference service was successfully deployed
function_nikon_2024-10-04 status is now torndown due to DeploymentManager action
chaiml-0917-bot-dominant_6324_v5 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 61.74s
Pipeline stage %s skipped, reason=%s
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v1
chaiml-0917-bot-dominant_6324_v5 status is now torndown due to DeploymentManager action
Pipeline stage MKMLModelDeleter completed in 44.66s
Pipeline stage %s skipped, reason=%s
Shutdown handler de-registered
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action
run pipeline %s
run pipeline %s
Shutdown handler not registered because Python interpreter is not running in the main thread
admin requested tearing down of jic062-dpo-v1-9-nemo_v1
chaiml-0917-bot-dominant_6324_v5 status is now torndown due to DeploymentManager action
Shutdown handler de-registered
Pipeline stage MKMLModelDeleter completed in 33.68s
Pipeline stage %s skipped, reason=%s
function_pinen_2024-09-26 status is now torndown due to DeploymentManager action