developer_uid: jxlu90
submission_id: function_gibet_2024-12-11
model_name: nemo70B_moonshine600_1line
model_group:
status: inactive
timestamp: 2024-12-11T23:21:00+00:00
num_battles: 382
num_wins: 174
family_friendly_score: 0.617
family_friendly_standard_error: 0.006874750904578289
submission_type: function
display_name: nemo70B_moonshine600_1line
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-11
win_ratio: 0.45549738219895286
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.018827199935913s
Received healthy response to inference request in 3.003973960876465s
Received healthy response to inference request in 2.464994192123413s
Received healthy response to inference request in 3.318079948425293s
Received healthy response to inference request in 2.3125550746917725s
5 requests
0 failed requests
5th percentile: 2.3430428981781004
10th percentile: 2.373530721664429
20th percentile: 2.434506368637085
30th percentile: 2.5727901458740234
40th percentile: 2.788382053375244
50th percentile: 3.003973960876465
60th percentile: 3.129616355895996
70th percentile: 3.255258750915527
80th percentile: 3.6582293987274173
90th percentile: 4.338528299331665
95th percentile: 4.678677749633788
99th percentile: 4.9507973098754885
mean time: 3.2236860752105714
Pipeline stage StressChecker completed in 18.31s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.13s
Shutdown handler de-registered
function_gibet_2024-12-11 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3207.41s
Shutdown handler de-registered
function_gibet_2024-12-11 status is now inactive due to admin request