developer_uid: chai_backend_admin
submission_id: function_bilet_2024-10-01
model_name: retune_with_base
model_group:
status: torndown
timestamp: 2024-10-01T03:23:29+00:00
num_battles: 40406
num_wins: 20598
celo_rating: 1262.63
family_friendly_score: 0.5785902538969068
family_friendly_standard_error: 0.0025381582625689045
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-09-30
win_ratio: 0.5097757758748701
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', '###', 'Bot:', 'User:', 'You:', '<|im_end|>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3762969970703125s
Received healthy response to inference request in 2.973071813583374s
Received healthy response to inference request in 3.337559223175049s
Received healthy response to inference request in 3.2705419063568115s
Received healthy response to inference request in 3.6315882205963135s
5 requests
0 failed requests
5th percentile: 3.0325658321380615
10th percentile: 3.092059850692749
20th percentile: 3.211047887802124
30th percentile: 3.283945369720459
40th percentile: 3.310752296447754
50th percentile: 3.337559223175049
60th percentile: 3.353054332733154
70th percentile: 3.36854944229126
80th percentile: 3.427355241775513
90th percentile: 3.529471731185913
95th percentile: 3.580529975891113
99th percentile: 3.6213765716552735
mean time: 3.317811632156372
Pipeline stage StressChecker completed in 18.46s
Shutdown handler de-registered
function_bilet_2024-10-01 status is now deployed due to DeploymentManager action
function_bilet_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_bilet_2024-10-01 status is now deployed due to admin request
function_bilet_2024-10-01 status is now inactive due to auto deactivation removed underperforming models
function_bilet_2024-10-01 status is now torndown due to DeploymentManager action