submission_id: function_bobib_2024-11-15
developer_uid: chai_backend_admin
celo_rating: 1250.27
display_name: retune_with_base
family_friendly_score: 0.5844
family_friendly_standard_error: 0.006969600275482089
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
is_internal_developer: True
model_group:
model_name: retune_with_base
num_battles: 10898
num_wins: 5501
ranking_group: single
status: inactive
submission_type: function
timestamp: 2024-11-15T21:51:12+00:00
us_pacific_date: 2024-11-15
win_ratio: 0.5047715177096715
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 4.025423049926758s
Received healthy response to inference request in 4.348702430725098s
Received healthy response to inference request in 4.301976680755615s
Received healthy response to inference request in 3.7776641845703125s
Received healthy response to inference request in 4.030771255493164s
5 requests
0 failed requests
5th percentile: 3.8272159576416014
10th percentile: 3.8767677307128907
20th percentile: 3.975871276855469
30th percentile: 4.026492691040039
40th percentile: 4.028631973266601
50th percentile: 4.030771255493164
60th percentile: 4.139253425598144
70th percentile: 4.247735595703125
80th percentile: 4.311321830749511
90th percentile: 4.3300121307373045
95th percentile: 4.3393572807312015
99th percentile: 4.346833400726318
mean time: 4.09690752029419
%s, retrying in %s seconds...
Received healthy response to inference request in 3.164686918258667s
Received healthy response to inference request in 2.5202322006225586s
Received healthy response to inference request in 2.318923234939575s
Received healthy response to inference request in 2.7865099906921387s
Received healthy response to inference request in 3.1805100440979004s
5 requests
0 failed requests
5th percentile: 2.3591850280761717
10th percentile: 2.3994468212127686
20th percentile: 2.479970407485962
30th percentile: 2.5734877586364746
40th percentile: 2.6799988746643066
50th percentile: 2.7865099906921387
60th percentile: 2.93778076171875
70th percentile: 3.089051532745361
80th percentile: 3.1678515434265138
90th percentile: 3.174180793762207
95th percentile: 3.1773454189300536
99th percentile: 3.179877119064331
mean time: 2.794172477722168
Pipeline stage StressChecker completed in 36.85s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 6.30s
Shutdown handler de-registered
function_bobib_2024-11-15 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3275.77s
Shutdown handler de-registered
function_bobib_2024-11-15 status is now inactive due to auto deactivation removed underperforming models