function_doham_2024-11-14

submission_id: function_doham_2024-11-14

developer_uid: chai_backend_admin

celo_rating: 1272.48

display_name: retune_with_base

family_friendly_score: 0.571

family_friendly_standard_error: 0.006999414261207862

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

is_internal_developer: True

model_group:

model_name: retune_with_base

num_battles: 13196

num_wins: 6867

ranking_group: single

status: inactive

submission_type: function

timestamp: 2024-11-14T21:43:00+00:00

us_pacific_date: 2024-11-14

win_ratio: 0.5203849651409518

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.692359209060669s
Received healthy response to inference request in 3.66965389251709s
Received healthy response to inference request in 3.9615681171417236s
Received healthy response to inference request in 3.8281052112579346s
Received healthy response to inference request in 2.9423563480377197s
5 requests
0 failed requests
5th percentile: 2.7423586368560793
10th percentile: 2.792358064651489
20th percentile: 2.8923569202423094
30th percentile: 3.087815856933594
40th percentile: 3.3787348747253416
50th percentile: 3.66965389251709
60th percentile: 3.7330344200134276
70th percentile: 3.7964149475097657
80th percentile: 3.8547977924346926
90th percentile: 3.908182954788208
95th percentile: 3.9348755359649656
99th percentile: 3.956229600906372
mean time: 3.4188085556030274
%s, retrying in %s seconds...
Received healthy response to inference request in 2.6685547828674316s
Received healthy response to inference request in 3.4911041259765625s
Received healthy response to inference request in 3.7775931358337402s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 2.7898080348968506s
Received healthy response to inference request in 3.4777774810791016s
5 requests
0 failed requests
5th percentile: 2.6928054332733153
10th percentile: 2.717056083679199
20th percentile: 2.765557384490967
30th percentile: 2.9274019241333007
40th percentile: 3.2025897026062013
50th percentile: 3.4777774810791016
60th percentile: 3.483108139038086
70th percentile: 3.4884387969970705
80th percentile: 3.548401927947998
90th percentile: 3.662997531890869
95th percentile: 3.7202953338623046
99th percentile: 3.766133575439453
mean time: 3.2409675121307373
Pipeline stage StressChecker completed in 36.07s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 6.28s
Shutdown handler de-registered
function_doham_2024-11-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3381.18s
Shutdown handler de-registered
function_doham_2024-11-14 status is now inactive due to auto deactivation removed underperforming models