submission_id: function_bikib_2024-11-16
developer_uid: chai_backend_admin
celo_rating: 1251.37
display_name: retune_with_base
family_friendly_score: 0.5780000000000001
family_friendly_standard_error: 0.006984497118619207
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 13643
num_wins: 6817
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-16T19:25:45+00:00
us_pacific_date: 2024-11-16
win_ratio: 0.49967016052187935
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.4574131965637207s
Received healthy response to inference request in 5.724813222885132s
Received healthy response to inference request in 1.9411804676055908s
Received healthy response to inference request in 3.1964197158813477s
Received healthy response to inference request in 4.087195634841919s
5 requests
0 failed requests
5th percentile: 2.044427013397217
10th percentile: 2.147673559188843
20th percentile: 2.3541666507720946
30th percentile: 2.605214500427246
40th percentile: 2.900817108154297
50th percentile: 3.1964197158813477
60th percentile: 3.552730083465576
70th percentile: 3.9090404510498047
80th percentile: 4.414719152450562
90th percentile: 5.069766187667847
95th percentile: 5.3972897052764885
99th percentile: 5.659308519363403
mean time: 3.481404447555542
%s, retrying in %s seconds...
Received healthy response to inference request in 4.557621955871582s
Received healthy response to inference request in 2.702887773513794s
Received healthy response to inference request in 2.334351062774658s
Received healthy response to inference request in 3.213672399520874s
Received healthy response to inference request in 3.5682308673858643s
5 requests
0 failed requests
5th percentile: 2.4080584049224854
10th percentile: 2.4817657470703125
20th percentile: 2.629180431365967
30th percentile: 2.80504469871521
40th percentile: 3.009358549118042
50th percentile: 3.213672399520874
60th percentile: 3.35549578666687
70th percentile: 3.497319173812866
80th percentile: 3.766109085083008
90th percentile: 4.161865520477295
95th percentile: 4.359743738174438
99th percentile: 4.518046312332153
mean time: 3.2753528118133546
Pipeline stage StressChecker completed in 36.30s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.74s
Shutdown handler de-registered
function_bikib_2024-11-16 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3110.40s
Shutdown handler de-registered
function_bikib_2024-11-16 status is now inactive due to auto deactivation removed underperforming models