submission_id: function_fakus_2024-11-29
developer_uid: chai_backend_admin
celo_rating: 1209.86
display_name: retune_with_base
family_friendly_score: 0.6152
family_friendly_standard_error: 0.006880827857169513
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 8946
num_wins: 3873
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-29T19:09:41+00:00
us_pacific_date: 2024-11-29
win_ratio: 0.4329309188464118
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.1779937744140625s
Received healthy response to inference request in 3.382221221923828s
Received healthy response to inference request in 3.7746756076812744s
Received healthy response to inference request in 3.8861773014068604s
Received healthy response to inference request in 5.162335395812988s
5 requests
0 failed requests
5th percentile: 3.4607120990753173
10th percentile: 3.5392029762268065
20th percentile: 3.6961847305297852
30th percentile: 3.7969759464263917
40th percentile: 3.841576623916626
50th percentile: 3.8861773014068604
60th percentile: 4.002903890609741
70th percentile: 4.119630479812622
80th percentile: 4.374862098693848
90th percentile: 4.768598747253418
95th percentile: 4.965467071533203
99th percentile: 5.122961730957031
mean time: 4.076680660247803
%s, retrying in %s seconds...
Received healthy response to inference request in 3.062779426574707s
Received healthy response to inference request in 5.69392728805542s
Received healthy response to inference request in 2.2854225635528564s
Received healthy response to inference request in 4.225005388259888s
Received healthy response to inference request in 3.6255948543548584s
5 requests
0 failed requests
5th percentile: 2.4408939361572264
Connection pool is full, discarding connection: %s. Connection pool size: %s
10th percentile: 2.5963653087615968
20th percentile: 2.907308053970337
30th percentile: 3.1753425121307375
40th percentile: 3.400468683242798
50th percentile: 3.6255948543548584
60th percentile: 3.86535906791687
70th percentile: 4.105123281478882
80th percentile: 4.518789768218994
90th percentile: 5.106358528137207
95th percentile: 5.4001429080963135
99th percentile: 5.635170412063599
mean time: 3.7785459041595457
%s, retrying in %s seconds...
Received healthy response to inference request in 3.9703125953674316s
Received healthy response to inference request in 2.7539243698120117s
Received healthy response to inference request in 2.685901641845703s
Received healthy response to inference request in 3.040536403656006s
Received healthy response to inference request in 3.7700576782226562s
5 requests
0 failed requests
5th percentile: 2.6995061874389648
10th percentile: 2.7131107330322264
20th percentile: 2.74031982421875
30th percentile: 2.8112467765808105
40th percentile: 2.9258915901184084
50th percentile: 3.040536403656006
60th percentile: 3.332344913482666
70th percentile: 3.624153423309326
80th percentile: 3.8101086616516113
90th percentile: 3.8902106285095215
95th percentile: 3.9302616119384766
99th percentile: 3.962302398681641
mean time: 3.244146537780762
Pipeline stage StressChecker completed in 59.03s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.47s
Shutdown handler de-registered
function_fakus_2024-11-29 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3781.57s
Shutdown handler de-registered
function_fakus_2024-11-29 status is now inactive due to auto deactivation removed underperforming models