developer_uid: jxlu90
submission_id: function_megor_2024-12-17
model_name: gasol_test
model_group:
status: inactive
timestamp: 2024-12-17T20:31:39+00:00
num_battles: 9528
num_wins: 4933
celo_rating: 1268.93
family_friendly_score: 0.5898
family_friendly_standard_error: 0.006956090281185258
submission_type: function
display_name: gasol_test
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-17
win_ratio: 0.5177371956339211
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3552942276000977s
Received healthy response to inference request in 2.674081563949585s
Received healthy response to inference request in 4.102248191833496s
Received healthy response to inference request in 2.6650636196136475s
Received healthy response to inference request in 1.7505979537963867s
5 requests
0 failed requests
5th percentile: 1.933491086959839
10th percentile: 2.116384220123291
20th percentile: 2.4821704864501952
30th percentile: 2.666867208480835
40th percentile: 2.67047438621521
50th percentile: 2.674081563949585
60th percentile: 2.94656662940979
70th percentile: 3.2190516948699948
80th percentile: 3.5046850204467774
90th percentile: 3.8034666061401365
95th percentile: 3.9528573989868163
99th percentile: 4.07237003326416
mean time: 2.9094571113586425
Pipeline stage StressChecker completed in 15.62s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.31s
Shutdown handler de-registered
function_megor_2024-12-17 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3355.22s
Shutdown handler de-registered
function_megor_2024-12-17 status is now inactive due to auto deactivation removed underperforming models