submission_id: function_poham_2024-08-19
developer_uid: chai_backend_admin
alignment_samples: 8325
alignment_score: 2.467485152573732
celo_rating: 1179.92
display_name: gpt4-tl
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.1, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', 'You:'], 'max_input_tokens': 512, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: gpt4-tl
num_battles: 8325
num_wins: 3622
propriety_score: 0.8069241011984021
propriety_total_count: 751.0
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-08-19T05:27:06+00:00
us_pacific_date: 2024-08-18
win_ratio: 0.4350750750750751
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 2.591855764389038s
Received healthy response to inference request in 2.319411039352417s
Received healthy response to inference request in 1.9831585884094238s
Received healthy response to inference request in 2.3735482692718506s
Received healthy response to inference request in 1.6125199794769287s
5 requests
0 failed requests
5th percentile: 1.6866477012634278
10th percentile: 1.7607754230499268
20th percentile: 1.9090308666229248
30th percentile: 2.0504090785980225
40th percentile: 2.1849100589752197
50th percentile: 2.319411039352417
60th percentile: 2.3410659313201903
70th percentile: 2.362720823287964
80th percentile: 2.417209768295288
90th percentile: 2.5045327663421633
95th percentile: 2.5481942653656007
99th percentile: 2.5831234645843506
mean time: 2.1760987281799316
Pipeline stage StressChecker completed in 11.45s
function_poham_2024-08-19 status is now deployed due to DeploymentManager action
function_poham_2024-08-19 status is now inactive due to admin request
function_poham_2024-08-19 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics