developer_uid: jxlu90
submission_id: function_fokam_2024-12-18
model_name: nemo
model_group:
status: inactive
timestamp: 2024-12-18T15:40:11+00:00
num_battles: 17205
num_wins: 7632
celo_rating: 1224.02
family_friendly_score: 0.6124
family_friendly_standard_error: 0.0068900833086400345
submission_type: function
display_name: nemo
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-18
win_ratio: 0.44359197907585
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.651822090148926s
Received healthy response to inference request in 2.688485622406006s
Received healthy response to inference request in 3.2108473777770996s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 3.002129316329956s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Connection pool is full, discarding connection: %s. Connection pool size: %s
Received healthy response to inference request in 4.916894197463989s
5 requests
0 failed requests
5th percentile: 2.751214361190796
10th percentile: 2.813943099975586
20th percentile: 2.939400577545166
30th percentile: 3.043872928619385
40th percentile: 3.127360153198242
50th percentile: 3.2108473777770996
60th percentile: 3.3872372627258303
70th percentile: 3.5636271476745605
80th percentile: 3.9048365116119386
90th percentile: 4.410865354537964
95th percentile: 4.663879776000976
99th percentile: 4.866291313171387
mean time: 3.4940357208251953
Pipeline stage StressChecker completed in 18.56s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.20s
Shutdown handler de-registered
function_fokam_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2752.32s
Shutdown handler de-registered
function_fokam_2024-12-18 status is now inactive due to auto deactivation removed underperforming models