developer_uid: jxlu90
submission_id: function_letol_2024-12-28
model_name: deepseek_test_alex_au
model_group:
status: torndown
timestamp: 2024-12-28T19:39:07+00:00
num_battles: 7252
num_wins: 2594
celo_rating: 1161.86
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: deepseek_test_alex_au
is_internal_developer: False
ranking_group: single
us_pacific_date: 2024-12-28
win_ratio: 0.35769442912300053
generation_params: {'temperature': 2.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['You:', '</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 1, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.582752227783203s
Received healthy response to inference request in 4.222894191741943s
Received healthy response to inference request in 2.7985997200012207s
Received healthy response to inference request in 3.7569446563720703s
Received healthy response to inference request in 2.2172186374664307s
5 requests
0 failed requests
5th percentile: 2.2903253555297853
10th percentile: 2.3634320735931396
20th percentile: 2.5096455097198485
30th percentile: 2.6259217262268066
40th percentile: 2.7122607231140137
50th percentile: 2.7985997200012207
60th percentile: 3.1819376945495605
70th percentile: 3.5652756690979004
80th percentile: 3.850134563446045
90th percentile: 4.036514377593994
95th percentile: 4.129704284667969
99th percentile: 4.204256210327149
mean time: 3.1156818866729736
Pipeline stage StressChecker completed in 16.78s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
function_letol_2024-12-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_letol_2024-12-28 status is now inactive due to admin request
function_letol_2024-12-28 status is now torndown due to DeploymentManager action
function_letol_2024-12-28 status is now torndown due to DeploymentManager action
function_letol_2024-12-28 status is now torndown due to DeploymentManager action