submission_id: function_terob_2024-10-20
developer_uid: chai_backend_admin
celo_rating: 1228.97
display_name: retune_with_base
family_friendly_score: 0.579982126899017
family_friendly_standard_error: 0.006177091132948633
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 6648
num_wins: 3349
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-10-20T05:01:18+00:00
us_pacific_date: 2024-10-19
win_ratio: 0.5037605294825511
Download Preference Data
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0432329177856445s
Received healthy response to inference request in 1.2791943550109863s
Received healthy response to inference request in 2.3489508628845215s
Received healthy response to inference request in 4.845101594924927s
Received healthy response to inference request in 6.173334360122681s
5 requests
0 failed requests
5th percentile: 1.4931456565856933
10th percentile: 1.7070969581604003
20th percentile: 2.1349995613098143
30th percentile: 2.487807273864746
40th percentile: 2.7655200958251953
50th percentile: 3.0432329177856445
60th percentile: 3.7639803886413574
70th percentile: 4.48472785949707
80th percentile: 5.110748147964478
90th percentile: 5.642041254043579
95th percentile: 5.907687807083129
99th percentile: 6.12020504951477
mean time: 3.537962818145752
%s, retrying in %s seconds...
Received healthy response to inference request in 6.968370199203491s
Received healthy response to inference request in 1.758075475692749s
Received healthy response to inference request in 3.0228447914123535s
Received healthy response to inference request in 2.9207441806793213s
Received healthy response to inference request in 2.7926456928253174s
5 requests
0 failed requests
5th percentile: 1.9649895191192628
10th percentile: 2.1719035625457765
20th percentile: 2.5857316493988036
30th percentile: 2.8182653903961183
40th percentile: 2.86950478553772
50th percentile: 2.9207441806793213
60th percentile: 2.9615844249725343
70th percentile: 3.0024246692657472
80th percentile: 3.811949872970582
90th percentile: 5.390160036087036
95th percentile: 6.179265117645263
99th percentile: 6.810549182891846
mean time: 3.4925360679626465
Pipeline stage StressChecker completed in 37.65s
Shutdown handler de-registered
function_terob_2024-10-20 status is now deployed due to DeploymentManager action
function_terob_2024-10-20 status is now inactive due to auto deactivation removed underperforming models