developer_uid: chai_backend_admin
submission_id: function_ganeb_2024-11-27
model_name: retune_with_base
model_group:
status: inactive
timestamp: 2024-11-27T22:10:24+00:00
num_battles: 10250
num_wins: 5383
celo_rating: 1273.95
family_friendly_score: 0.5888
family_friendly_standard_error: 0.006958657341757819
submission_type: function
display_name: retune_with_base
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-11-27
win_ratio: 0.5251707317073171
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.286146640777588s
Received healthy response to inference request in 4.075252056121826s
Failed to get response for submission function_doteb_2024-11-27: no entry with id "fake_submission_ifd_for_testing" found on database!
Received healthy response to inference request in 3.2122204303741455s
Received healthy response to inference request in 4.5154869556427s
Received healthy response to inference request in 3.7099242210388184s
5 requests
0 failed requests
5th percentile: 3.227005672454834
10th percentile: 3.2417909145355224
20th percentile: 3.2713613986968992
30th percentile: 3.370902156829834
40th percentile: 3.540413188934326
50th percentile: 3.7099242210388184
60th percentile: 3.8560553550720216
70th percentile: 4.002186489105225
80th percentile: 4.163299036026001
90th percentile: 4.33939299583435
95th percentile: 4.427439975738525
99th percentile: 4.497877559661865
mean time: 3.7598060607910155
%s, retrying in %s seconds...
Received healthy response to inference request in 3.0000994205474854s
Received healthy response to inference request in 3.2480902671813965s
Received healthy response to inference request in 3.665088415145874s
Received healthy response to inference request in 3.278388500213623s
Failed to get response for submission function_doteb_2024-11-27: no entry with id "fake_submission_ifd_for_testing" found on database!
Received healthy response to inference request in 3.43371844291687s
5 requests
0 failed requests
5th percentile: 3.0496975898742678
10th percentile: 3.0992957592010497
20th percentile: 3.198492097854614
30th percentile: 3.254149913787842
40th percentile: 3.2662692070007324
50th percentile: 3.278388500213623
60th percentile: 3.340520477294922
70th percentile: 3.402652454376221
80th percentile: 3.4799924373626707
90th percentile: 3.5725404262542724
95th percentile: 3.6188144207000734
99th percentile: 3.655833616256714
mean time: 3.32507700920105
Pipeline stage StressChecker completed in 37.63s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.33s
Shutdown handler de-registered
function_ganeb_2024-11-27 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4904.99s
Shutdown handler de-registered
function_ganeb_2024-11-27 status is now inactive due to auto deactivation removed underperforming models