function_pasal_2024-12-08

developer_uid: chai_backend_admin

submission_id: function_pasal_2024-12-08

model_name: retune_with_base

model_group:

status: torndown

timestamp: 2024-12-08T05:37:13+00:00

num_battles: 10056

num_wins: 5018

celo_rating: 1258.69

family_friendly_score: 0.6158

family_friendly_standard_error: 0.006878813269743554

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-12-07

win_ratio: 0.49900556881463803

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.6474459171295166s
Received healthy response to inference request in 3.7108218669891357s
Received healthy response to inference request in 3.150916576385498s
Received healthy response to inference request in 3.754287004470825s
Received healthy response to inference request in 3.7084317207336426s
5 requests
0 failed requests
5th percentile: 2.748140048980713
10th percentile: 2.848834180831909
20th percentile: 3.0502224445343016
30th percentile: 3.262419605255127
40th percentile: 3.485425662994385
50th percentile: 3.7084317207336426
60th percentile: 3.70938777923584
70th percentile: 3.710343837738037
80th percentile: 3.7195148944854735
90th percentile: 3.7369009494781493
95th percentile: 3.7455939769744875
99th percentile: 3.7525483989715576
mean time: 3.3943806171417235
%s, retrying in %s seconds...
Received healthy response to inference request in 2.826528549194336s
Received healthy response to inference request in 3.906775712966919s
Received healthy response to inference request in 3.749274253845215s
Received healthy response to inference request in 4.178870916366577s
Received healthy response to inference request in 4.514646768569946s
5 requests
0 failed requests
5th percentile: 3.0110776901245115
10th percentile: 3.1956268310546876
20th percentile: 3.5647251129150392
30th percentile: 3.780774545669556
40th percentile: 3.8437751293182374
50th percentile: 3.906775712966919
60th percentile: 4.015613794326782
70th percentile: 4.1244518756866455
80th percentile: 4.246026086807251
90th percentile: 4.380336427688599
95th percentile: 4.447491598129273
99th percentile: 4.501215734481812
mean time: 3.8352192401885987
%s, retrying in %s seconds...
Received healthy response to inference request in 2.9595117568969727s
Received healthy response to inference request in 3.6031787395477295s
Received healthy response to inference request in 3.159407615661621s
Received healthy response to inference request in 2.376373052597046s
Received healthy response to inference request in 3.458402395248413s
5 requests
0 failed requests
5th percentile: 2.493000793457031
10th percentile: 2.6096285343170167
20th percentile: 2.8428840160369875
30th percentile: 2.9994909286499025
40th percentile: 3.079449272155762
50th percentile: 3.159407615661621
60th percentile: 3.279005527496338
70th percentile: 3.3986034393310547
80th percentile: 3.487357664108276
90th percentile: 3.545268201828003
95th percentile: 3.5742234706878664
99th percentile: 3.597387685775757
mean time: 3.1113747119903565
Pipeline stage StressChecker completed in 55.10s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.42s
Shutdown handler de-registered
function_pasal_2024-12-08 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3216.51s
Shutdown handler de-registered
function_pasal_2024-12-08 status is now inactive due to auto deactivation removed underperforming models
function_pasal_2024-12-08 status is now torndown due to DeploymentManager action
function_pasal_2024-12-08 status is now torndown due to DeploymentManager action
function_pasal_2024-12-08 status is now torndown due to DeploymentManager action