submission_id: function_rareb_2024-09-14
developer_uid: chai_backend_admin
celo_rating: 1260.55
display_name: dpo_with_ava_reward_100k_v1
family_friendly_score: 0.0
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.95, 'top_p': 1.0, 'min_p': 0.08, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '<|eot_id|>'], 'max_input_tokens': 512, 'best_of': 16, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: dpo_with_ava_reward_100k_v1
num_battles: 17715
num_wins: 8899
ranking_group: single
status: torndown
submission_type: function
timestamp: 2024-09-14T21:08:30+00:00
us_pacific_date: 2024-09-14
win_ratio: 0.5023426474738922
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.9654428958892822s
Received healthy response to inference request in 4.539630651473999s
Received healthy response to inference request in 3.1194632053375244s
Received healthy response to inference request in 3.323385238647461s
Received healthy response to inference request in 4.6164772510528564s
5 requests
0 failed requests
5th percentile: 3.1602476119995115
10th percentile: 3.201032018661499
20th percentile: 3.282600831985474
30th percentile: 3.451796770095825
40th percentile: 3.7086198329925537
50th percentile: 3.9654428958892822
60th percentile: 4.195117998123169
70th percentile: 4.424793100357055
80th percentile: 4.554999971389771
90th percentile: 4.585738611221314
95th percentile: 4.601107931137085
99th percentile: 4.613403387069702
mean time: 3.9128798484802245
Pipeline stage StressChecker completed in 20.21s
Shutdown handler de-registered
function_rareb_2024-09-14 status is now deployed due to DeploymentManager action
function_rareb_2024-09-14 status is now inactive due to auto deactivation removed underperforming models
function_rareb_2024-09-14 status is now torndown due to DeploymentManager action