developer_uid: azuruce
submission_id: function_masun_2025-02-26
model_name: grok2
model_group:
status: torndown
timestamp: 2025-02-26T23:34:14+00:00
num_battles: 5662
num_wins: 2890
celo_rating: 1283.05
family_friendly_score: 0.5616
family_friendly_standard_error: 0.007017199441372605
submission_type: function
display_name: grok2
is_internal_developer: False
ranking_group: single
us_pacific_date: 2025-02-26
win_ratio: 0.510420346167432
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['User:', 'Me:', 'You:'], 'max_input_tokens': 1024, 'best_of': 1, 'max_output_tokens': 512}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.9901599884033203s
Received healthy response to inference request in 5.402710199356079s
Received healthy response to inference request in 3.5942952632904053s
Received healthy response to inference request in 4.068853378295898s
Received healthy response to inference request in 2.4842369556427s
5 requests
0 failed requests
5th percentile: 2.585421562194824
10th percentile: 2.6866061687469482
20th percentile: 2.8889753818511963
30th percentile: 3.1109870433807374
40th percentile: 3.352641153335571
50th percentile: 3.5942952632904053
60th percentile: 3.7841185092926026
70th percentile: 3.9739417552947995
80th percentile: 4.335624742507934
90th percentile: 4.869167470932007
95th percentile: 5.135938835144043
99th percentile: 5.349355926513672
mean time: 3.708051156997681
%s, retrying in %s seconds...
Received healthy response to inference request in 3.381537914276123s
Received healthy response to inference request in 2.5815842151641846s
Received healthy response to inference request in 3.6009199619293213s
Received healthy response to inference request in 6.293923854827881s
Received healthy response to inference request in 1.9795796871185303s
5 requests
0 failed requests
5th percentile: 2.099980592727661
10th percentile: 2.220381498336792
20th percentile: 2.4611833095550537
30th percentile: 2.7415749549865724
40th percentile: 3.0615564346313477
50th percentile: 3.381537914276123
60th percentile: 3.4692907333374023
70th percentile: 3.5570435523986816
80th percentile: 4.139520740509034
90th percentile: 5.216722297668458
95th percentile: 5.755323076248168
99th percentile: 6.186203699111938
mean time: 3.567509126663208
Pipeline stage StressChecker completed in 38.45s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_masun_2025-02-26 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2692.99s
Shutdown handler de-registered
function_masun_2025-02-26 status is now inactive due to auto deactivation removed underperforming models
function_masun_2025-02-26 status is now torndown due to DeploymentManager action