submission_id: function_jelur_2024-08-09
developer_uid: chai_backend_admin
alignment_samples: 1530
alignment_score: 5.560522433570477
celo_rating: 1097.08
display_name: deepseek-chat
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 1.5, 'top_p': 0.99, 'min_p': 0.1, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|end▁of▁sentence|>'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64, 'reward_max_token_input': 256}
is_internal_developer: True
model_group:
model_name: deepseek-chat
num_battles: 31134
num_wins: 10413
propriety_score: 0.7111111111111111
propriety_total_count: 2790.0
ranking_group: single
reward_repo: ChaiML/gpt2_xl_pairwise_89m_step_347634
status: torndown
submission_type: function
timestamp: 2024-08-09T04:08:15+00:00
us_pacific_date: 2024-08-08
win_ratio: 0.33445750626324916
Download Preference Data
Resubmit model
Running pipeline stage StressChecker
Received healthy response to inference request in 4.299470663070679s
Received healthy response to inference request in 3.3890981674194336s
Received healthy response to inference request in 2.1784629821777344s
Received healthy response to inference request in 2.862039804458618s
Received healthy response to inference request in 3.621262550354004s
5 requests
0 failed requests
5th percentile: 2.3151783466339113
10th percentile: 2.451893711090088
20th percentile: 2.7253244400024412
30th percentile: 2.967451477050781
40th percentile: 3.1782748222351076
50th percentile: 3.3890981674194336
60th percentile: 3.4819639205932615
70th percentile: 3.57482967376709
80th percentile: 3.756904172897339
90th percentile: 4.028187417984009
95th percentile: 4.163829040527344
99th percentile: 4.272342338562011
mean time: 3.270066833496094
Pipeline stage StressChecker completed in 16.92s
function_jelur_2024-08-09 status is now deployed due to DeploymentManager action
function_jelur_2024-08-09 status is now inactive due to auto deactivation removed underperforming models
function_jelur_2024-08-09 status is now deployed due to admin request
function_jelur_2024-08-09 status is now inactive due to auto deactivation removed underperforming models
function_jelur_2024-08-09 status is now torndown due to DeploymentManager action
function_jelur_2024-08-09 status is now torndown due to DeploymentManager action

Usage Metrics

Latency Metrics