function_fogim_2024-11-12

submission_id: function_fogim_2024-11-12

developer_uid: chai_backend_admin

celo_rating: 1252.63

display_name: retune_with_base

family_friendly_score: 0.5864

family_friendly_standard_error: 0.006964697265495466

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}

is_internal_developer: True

model_group:

model_name: retune_with_base

num_battles: 11546

num_wins: 5916

ranking_group: single

status: inactive

submission_type: function

timestamp: 2024-11-12T19:51:30+00:00

us_pacific_date: 2024-11-12

win_ratio: 0.5123852416421272

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.467736721038818s
Received healthy response to inference request in 2.810116767883301s
Received healthy response to inference request in 2.982396125793457s
Received healthy response to inference request in 4.4420576095581055s
Received healthy response to inference request in 7.04463005065918s
5 requests
0 failed requests
5th percentile: 2.844572639465332
10th percentile: 2.8790285110473635
20th percentile: 2.9479402542114257
30th percentile: 3.274328422546387
40th percentile: 3.858193016052246
50th percentile: 4.4420576095581055
60th percentile: 4.852329254150391
70th percentile: 5.262600898742676
80th percentile: 5.783115386962891
90th percentile: 6.413872718811035
95th percentile: 6.729251384735107
99th percentile: 6.981554317474365
mean time: 4.549387454986572
%s, retrying in %s seconds...
Received healthy response to inference request in 7.669103145599365s
Received healthy response to inference request in 4.426404237747192s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 13.528561115264893s
Received healthy response to inference request in 3.3925137519836426s
Received healthy response to inference request in 2.0338540077209473s
5 requests
0 failed requests
5th percentile: 2.3055859565734864
10th percentile: 2.5773179054260256
20th percentile: 3.1207818031311034
30th percentile: 3.5992918491363524
40th percentile: 4.012848043441773
50th percentile: 4.426404237747192
60th percentile: 5.7234838008880615
70th percentile: 7.02056336402893
80th percentile: 8.840994739532471
90th percentile: 11.184777927398683
95th percentile: 12.356669521331787
99th percentile: 13.294182796478271
mean time: 6.210087251663208
%s, retrying in %s seconds...
Received healthy response to inference request in 2.642648458480835s
Received healthy response to inference request in 4.336726665496826s
Received healthy response to inference request in 3.406975030899048s
Received healthy response to inference request in 2.746645212173462s
Received healthy response to inference request in 2.6888368129730225s
5 requests
0 failed requests
5th percentile: 2.6518861293792724
10th percentile: 2.66112380027771
20th percentile: 2.679599142074585
30th percentile: 2.70039849281311
40th percentile: 2.723521852493286
50th percentile: 2.746645212173462
60th percentile: 3.010777139663696
70th percentile: 3.2749090671539305
80th percentile: 3.592925357818604
90th percentile: 3.9648260116577148
95th percentile: 4.150776338577271
99th percentile: 4.299536600112915
mean time: 3.164366436004639
Pipeline stage StressChecker completed in 73.07s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.26s
Shutdown handler de-registered
function_fogim_2024-11-12 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3050.69s
Shutdown handler de-registered
function_fogim_2024-11-12 status is now inactive due to auto deactivation removed underperforming models