function_bileb_2024-11-22

developer_uid: chai_backend_admin

submission_id: function_bileb_2024-11-22

model_name: retune_with_base

model_group:

status: inactive

timestamp: 2024-11-22T00:04:30+00:00

num_battles: 10009

num_wins: 5430

celo_rating: 1280.71

family_friendly_score: 0.5826

family_friendly_standard_error: 0.006973911958148023

submission_type: function

display_name: retune_with_base

is_internal_developer: True

ranking_group: single

us_pacific_date: 2024-11-21

win_ratio: 0.5425117394345089

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.687471628189087s
Received healthy response to inference request in 2.580751657485962s
Received healthy response to inference request in 3.146202564239502s
Received healthy response to inference request in 3.7439050674438477s
Received healthy response to inference request in 5.799842596054077s
5 requests
0 failed requests
5th percentile: 2.69384183883667
10th percentile: 2.8069320201873778
20th percentile: 3.033112382888794
30th percentile: 3.254456377029419
40th percentile: 3.4709640026092528
50th percentile: 3.687471628189087
60th percentile: 3.710045003890991
70th percentile: 3.7326183795928953
80th percentile: 4.155092573165894
90th percentile: 4.977467584609985
95th percentile: 5.388655090332031
99th percentile: 5.7176050949096675
mean time: 3.791634702682495
%s, retrying in %s seconds...
Received healthy response to inference request in 2.871427536010742s
Received healthy response to inference request in 2.657174587249756s
Received healthy response to inference request in 3.0366733074188232s
Received healthy response to inference request in 3.5252087116241455s
Received healthy response to inference request in 4.051721096038818s
5 requests
0 failed requests
5th percentile: 2.700025177001953
10th percentile: 2.7428757667541506
20th percentile: 2.828576946258545
30th percentile: 2.904476690292358
40th percentile: 2.9705749988555907
50th percentile: 3.0366733074188232
60th percentile: 3.2320874691009522
70th percentile: 3.427501630783081
80th percentile: 3.63051118850708
90th percentile: 3.8411161422729494
95th percentile: 3.946418619155884
99th percentile: 4.030660600662231
mean time: 3.228441047668457
Pipeline stage StressChecker completed in 37.58s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.29s
Shutdown handler de-registered
function_bileb_2024-11-22 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3733.56s
Shutdown handler de-registered
function_bileb_2024-11-22 status is now inactive due to auto deactivation removed underperforming models