developer_uid: jxlu90
submission_id: function_jokot_2024-12-18
model_name: nitral_ai_bmo_1k
model_group:
status: inactive
timestamp: 2024-12-18T21:36:18+00:00
num_battles: 16400
num_wins: 8840
celo_rating: 1290.41
family_friendly_score: 0.5826
family_friendly_standard_error: 0.006973911958148023
submission_type: function
display_name: nitral_ai_bmo_1k
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-18
win_ratio: 0.5390243902439025
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.8990833759307861s
Received healthy response to inference request in 1.7310435771942139s
Received healthy response to inference request in 1.640183687210083s
Received healthy response to inference request in 1.5691189765930176s
Received healthy response to inference request in 1.7644927501678467s
5 requests
0 failed requests
5th percentile: 1.5833319187164308
10th percentile: 1.5975448608398437
20th percentile: 1.6259707450866698
30th percentile: 1.6583556652069091
40th percentile: 1.6946996212005616
50th percentile: 1.7310435771942139
60th percentile: 1.744423246383667
70th percentile: 1.75780291557312
80th percentile: 1.7914108753204345
90th percentile: 1.8452471256256104
95th percentile: 1.8721652507781983
99th percentile: 1.8936997509002687
mean time: 1.7207844734191895
Pipeline stage StressChecker completed in 9.90s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.48s
Shutdown handler de-registered
function_jokot_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3986.71s
Shutdown handler de-registered
function_jokot_2024-12-18 status is now inactive due to auto deactivation removed underperforming models