function_gijos_2024-12-08

developer_uid: chai_backend_admin

submission_id: function_gijos_2024-12-08

model_name: retune_with_base

model_group:

status: torndown

timestamp: 2024-12-08T23:24:45+00:00

num_battles: 12319

num_wins: 6704

celo_rating: 1284.13

family_friendly_score: 0.6022000000000001

family_friendly_standard_error: 0.006921779539973806

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-08

win_ratio: 0.5442000162350841

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.001697063446045s
Received healthy response to inference request in 3.8359477519989014s
Received healthy response to inference request in 3.270087957382202s
Received healthy response to inference request in 2.7556662559509277s
Received healthy response to inference request in 3.808403968811035s
5 requests
0 failed requests
5th percentile: 2.804872417449951
10th percentile: 2.8540785789489744
20th percentile: 2.9524909019470216
30th percentile: 3.0553752422332763
40th percentile: 3.1627315998077394
50th percentile: 3.270087957382202
60th percentile: 3.4854143619537354
70th percentile: 3.7007407665252683
80th percentile: 3.8139127254486085
90th percentile: 3.8249302387237547
95th percentile: 3.830438995361328
99th percentile: 3.8348460006713867
mean time: 3.3343605995178223
%s, retrying in %s seconds...
Received healthy response to inference request in 2.4928035736083984s
Received healthy response to inference request in 2.9600961208343506s
Received healthy response to inference request in 2.378424882888794s
Received healthy response to inference request in 3.00197172164917s
Received healthy response to inference request in 4.438875913619995s
5 requests
0 failed requests
5th percentile: 2.401300621032715
10th percentile: 2.4241763591766357
20th percentile: 2.4699278354644774
30th percentile: 2.586262083053589
40th percentile: 2.7731791019439695
50th percentile: 2.9600961208343506
60th percentile: 2.9768463611602782
70th percentile: 2.993596601486206
80th percentile: 3.2893525600433353
90th percentile: 3.864114236831665
95th percentile: 4.15149507522583
99th percentile: 4.381399745941162
mean time: 3.0544344425201415
Pipeline stage StressChecker completed in 34.13s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.12s
Shutdown handler de-registered
function_gijos_2024-12-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3397.12s
Shutdown handler de-registered
function_gijos_2024-12-08 status is now inactive due to auto deactivation removed underperforming models
function_gijos_2024-12-08 status is now torndown due to DeploymentManager action
function_gijos_2024-12-08 status is now torndown due to DeploymentManager action
function_gijos_2024-12-08 status is now torndown due to DeploymentManager action