developer_uid: jxlu90
submission_id: function_jibaf_2024-12-18
model_name: nemo_anthropic_v9_1k
model_group:
status: inactive
timestamp: 2024-12-18T20:08:01+00:00
num_battles: 11925
num_wins: 6508
celo_rating: 1288.19
family_friendly_score: 0.5813999999999999
family_friendly_standard_error: 0.006976733333014814
submission_type: function
display_name: nemo_anthropic_v9_1k
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-18
win_ratio: 0.5457442348008386
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.9357385635375977s
Received healthy response to inference request in 2.4311623573303223s
Received healthy response to inference request in 2.2721567153930664s
Received healthy response to inference request in 1.7109391689300537s
Received healthy response to inference request in 1.7199597358703613s
5 requests
0 failed requests
5th percentile: 1.7127432823181152
10th percentile: 1.7145473957061768
20th percentile: 1.7181556224822998
30th percentile: 1.7631155014038087
40th percentile: 1.8494270324707032
50th percentile: 1.9357385635375977
60th percentile: 2.070305824279785
70th percentile: 2.2048730850219727
80th percentile: 2.3039578437805175
90th percentile: 2.36756010055542
95th percentile: 2.399361228942871
99th percentile: 2.424802131652832
mean time: 2.0139913082122805
Pipeline stage StressChecker completed in 11.25s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.13s
Shutdown handler de-registered
function_jibaf_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3123.62s
Shutdown handler de-registered
function_jibaf_2024-12-18 status is now inactive due to auto deactivation removed underperforming models