developer_uid: chai_backend_admin
submission_id: function_kojol_2024-08-16
model_name: gpt4-tl
model_group:
status: torndown
timestamp: 2024-08-16T05:40:36+00:00
num_battles: 10364
num_wins: 5121
celo_rating: 1225.39
family_friendly_score: 0.0
submission_type: function
display_name: gpt4-tl
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-08-15
win_ratio: 0.4941142416055577
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Running pipeline stage StressChecker
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.9296257495880127s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.8326423168182373s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 3.6522998809814453s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 2.7692086696624756s
HTTP Request: %s %s "%s %d %s"
Received healthy response to inference request in 5.624191999435425s
5 requests
0 failed requests
5th percentile: 2.781895399093628
10th percentile: 2.7945821285247803
20th percentile: 2.819955587387085
30th percentile: 2.996573829650879
40th percentile: 3.3244368553161623
50th percentile: 3.6522998809814453
60th percentile: 3.763230228424072
70th percentile: 3.874160575866699
80th percentile: 4.268538999557496
90th percentile: 4.94636549949646
95th percentile: 5.285278749465942
99th percentile: 5.5564093494415285
mean time: 3.761593723297119
Pipeline stage StressChecker completed in 22.02s
function_kojol_2024-08-16 status is now deployed due to DeploymentManager action
function_kojol_2024-08-16 status is now inactive due to auto deactivation removed underperforming models
function_kojol_2024-08-16 status is now torndown due to DeploymentManager action