developer_uid: chai_backend_admin
submission_id: function_tekan_2024-10-05
model_name: reward_blend_default_full_bon
model_group:
status: torndown
timestamp: 2024-10-05T01:54:18+00:00
num_battles: 4404
num_wins: 2321
celo_rating: 1273.18
family_friendly_score: 0.5671720769309048
family_friendly_standard_error: 0.004860173256992481
submission_type: function
display_name: reward_blend_default_full_bon
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-10-04
win_ratio: 0.5270208900999092
generation_params: {'temperature': 0.9, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 50, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>', '<|user|>', '###'], 'max_input_tokens': 512, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3898487091064453s
Received healthy response to inference request in 3.735586643218994s
Received healthy response to inference request in 5.196417808532715s
Received healthy response to inference request in 3.0118560791015625s
Received healthy response to inference request in 2.902067184448242s
5 requests
0 failed requests
5th percentile: 2.924024963378906
10th percentile: 2.94598274230957
20th percentile: 2.9898983001708985
30th percentile: 3.087454605102539
40th percentile: 3.238651657104492
50th percentile: 3.3898487091064453
60th percentile: 3.528143882751465
70th percentile: 3.6664390563964844
80th percentile: 4.027752876281738
90th percentile: 4.612085342407227
95th percentile: 4.904251575469971
99th percentile: 5.137984561920166
mean time: 3.647155284881592
Pipeline stage StressChecker completed in 24.92s
Shutdown handler de-registered
function_tekan_2024-10-05 status is now deployed due to DeploymentManager action
function_tekan_2024-10-05 status is now inactive due to auto deactivation removed underperforming models
function_tekan_2024-10-05 status is now torndown due to DeploymentManager action