developer_uid: chai_backend_admin
submission_id: function_tofam_2024-12-05
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-12-05T17:37:21+00:00
num_battles: 12400
num_wins: 6117
celo_rating: 1258.24
family_friendly_score: 0.5953999999999999
family_friendly_standard_error: 0.006941164743758788
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-05
win_ratio: 0.4933064516129032
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.773263454437256s
Received healthy response to inference request in 2.659454345703125s
Received healthy response to inference request in 3.2130134105682373s
Received healthy response to inference request in 3.463165044784546s
Received healthy response to inference request in 2.3997690677642822s
5 requests
0 failed requests
5th percentile: 2.451706123352051
10th percentile: 2.5036431789398192
20th percentile: 2.6075172901153563
30th percentile: 2.7701661586761475
40th percentile: 2.9915897846221924
50th percentile: 3.2130134105682373
60th percentile: 3.313074064254761
70th percentile: 3.413134717941284
80th percentile: 3.725184726715088
90th percentile: 4.249224090576172
95th percentile: 4.511243772506714
99th percentile: 4.720859518051148
mean time: 3.301733064651489
Pipeline stage StressChecker completed in 17.73s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.31s
Shutdown handler de-registered
function_tofam_2024-12-05 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3063.51s
Shutdown handler de-registered
function_tofam_2024-12-05 status is now inactive due to auto deactivation removed underperforming models