function_feheb_2024-12-08

developer_uid: chai_backend_admin

submission_id: function_feheb_2024-12-08

model_name: retune_with_base

model_group:

status: inactive

timestamp: 2024-12-08T05:24:45+00:00

num_battles: 12017

num_wins: 6162

celo_rating: 1268.95

family_friendly_score: 0.5846

family_friendly_standard_error: 0.006969115295358515

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-07

win_ratio: 0.5127735707747358

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.0045855045318604s
Received healthy response to inference request in 2.3456292152404785s
Received healthy response to inference request in 2.5865371227264404s
Received healthy response to inference request in 2.9023287296295166s
Received healthy response to inference request in 2.94163179397583s
5 requests
0 failed requests
5th percentile: 2.3938107967376707
10th percentile: 2.4419923782348634
20th percentile: 2.5383555412292482
30th percentile: 2.6496954441070555
40th percentile: 2.776012086868286
50th percentile: 2.9023287296295166
60th percentile: 2.918049955368042
70th percentile: 2.933771181106567
80th percentile: 2.954222536087036
90th percentile: 2.979404020309448
95th percentile: 2.991994762420654
99th percentile: 3.002067356109619
mean time: 2.7561424732208253
Pipeline stage StressChecker completed in 15.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.38s
Shutdown handler de-registered
function_feheb_2024-12-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3157.70s
Shutdown handler de-registered
function_feheb_2024-12-08 status is now inactive due to auto deactivation removed underperforming models