developer_uid: jxlu90
submission_id: function_rinur_2024-12-14
model_name: llama
model_group:
status: inactive
timestamp: 2024-12-14T18:02:20+00:00
num_battles: 10497
num_wins: 5170
celo_rating: 1256.7
family_friendly_score: 0.5986
family_friendly_standard_error: 0.006932215230357464
submission_type: function
display_name: llama
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-14
win_ratio: 0.4925216728589121
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 1024, 'best_of': 4, 'max_output_tokens': 68}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.5318596363067627s
Received healthy response to inference request in 3.456684112548828s
Received healthy response to inference request in 3.326724052429199s
Received healthy response to inference request in 3.1804802417755127s
Received healthy response to inference request in 4.3019514083862305s
5 requests
0 failed requests
5th percentile: 3.20972900390625
10th percentile: 3.2389777660369874
20th percentile: 3.297475290298462
30th percentile: 3.352716064453125
40th percentile: 3.4047000885009764
50th percentile: 3.456684112548828
60th percentile: 3.486754322052002
70th percentile: 3.5168245315551756
80th percentile: 3.6858779907226564
90th percentile: 3.9939146995544434
95th percentile: 4.147933053970337
99th percentile: 4.2711477375030515
mean time: 3.5595398902893067
Pipeline stage StressChecker completed in 18.93s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.12s
Shutdown handler de-registered
function_rinur_2024-12-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4069.21s
Shutdown handler de-registered
function_rinur_2024-12-14 status is now inactive due to auto deactivation removed underperforming models