function_kukuk_2024-12-19

developer_uid: jxlu90

submission_id: function_kukuk_2024-12-19

model_name: run_3_v65_moonshine_2kmax

model_group:

status: torndown

timestamp: 2024-12-19T15:57:44+00:00

num_battles: 9314

num_wins: 4835

celo_rating: 1274.54

family_friendly_score: 0.0

family_friendly_standard_error: 0.0

submission_type: function

display_name: run_3_v65_moonshine_2kmax

is_internal_developer: False

ranking_group: single

us_pacific_date: 2024-12-19

win_ratio: 0.5191110156753275

generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['</s>', '\n', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}

formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}

Resubmit model

Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5946178436279297s
Received healthy response to inference request in 2.203502893447876s
Received healthy response to inference request in 2.1403512954711914s
Received healthy response to inference request in 2.6119749546051025s
Received healthy response to inference request in 2.4324254989624023s
5 requests
0 failed requests
5th percentile: 2.1529816150665284
10th percentile: 2.1656119346618654
20th percentile: 2.190872573852539
30th percentile: 2.249287414550781
40th percentile: 2.3408564567565917
50th percentile: 2.4324254989624023
60th percentile: 2.497302436828613
70th percentile: 2.562179374694824
80th percentile: 2.598089265823364
90th percentile: 2.6050321102142333
95th percentile: 2.608503532409668
99th percentile: 2.611280670166016
mean time: 2.3965744972229004
Pipeline stage StressChecker completed in 13.12s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.14s
Shutdown handler de-registered
function_kukuk_2024-12-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_kukuk_2024-12-19 status is now torndown due to DeploymentManager action
function_kukuk_2024-12-19 status is now torndown due to DeploymentManager action
function_kukuk_2024-12-19 status is now torndown due to DeploymentManager action