developer_uid: jxlu90
submission_id: function_dimib_2024-12-12
model_name: nemo70B
model_group:
status: inactive
timestamp: 2024-12-12T04:17:40+00:00
num_battles: 1904
num_wins: 864
celo_rating: 1229.71
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: nemo70B
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-11
win_ratio: 0.453781512605042
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.9770894050598145s
Received healthy response to inference request in 2.4187967777252197s
Received healthy response to inference request in 3.049631357192993s
Received healthy response to inference request in 3.5932328701019287s
Received healthy response to inference request in 2.4665918350219727s
5 requests
0 failed requests
5th percentile: 2.4283557891845704
10th percentile: 2.437914800643921
20th percentile: 2.457032823562622
30th percentile: 2.5831997394561768
40th percentile: 2.816415548324585
50th percentile: 3.049631357192993
60th percentile: 3.2670719623565674
70th percentile: 3.4845125675201416
80th percentile: 4.070004177093506
90th percentile: 5.023546791076661
95th percentile: 5.500318098068237
99th percentile: 5.881735143661499
mean time: 3.501068449020386
Pipeline stage StressChecker completed in 18.68s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.10s
Shutdown handler de-registered
function_dimib_2024-12-12 status is now deployed due to DeploymentManager action
function_dimib_2024-12-12 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
function_dimib_2024-12-12 status is now inactive due to admin request