developer_uid: jxlu90
submission_id: function_muhik_2024-12-18
model_name: run_3_v65
model_group:
status: inactive
timestamp: 2024-12-18T23:37:15+00:00
num_battles: 8292
num_wins: 4380
celo_rating: 1282.58
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: run_3_v65
is_internal_developer: True
ranking_group: single
us_pacific_date: 2024-12-18
win_ratio: 0.5282199710564399
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n', '</s>', 'You:'], 'max_input_tokens': 2048, 'best_of': 4, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 1.955493688583374s
Received healthy response to inference request in 1.7250277996063232s
Received healthy response to inference request in 1.7842950820922852s
Received healthy response to inference request in 2.262416362762451s
Received healthy response to inference request in 1.3988358974456787s
5 requests
0 failed requests
5th percentile: 1.4640742778778075
10th percentile: 1.5293126583099366
20th percentile: 1.6597894191741944
30th percentile: 1.7368812561035156
40th percentile: 1.7605881690979004
50th percentile: 1.7842950820922852
60th percentile: 1.8527745246887206
70th percentile: 1.9212539672851563
80th percentile: 2.0168782234191895
90th percentile: 2.13964729309082
95th percentile: 2.2010318279266357
99th percentile: 2.250139455795288
mean time: 1.8252137660980225
Pipeline stage StressChecker completed in 10.20s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.50s
Shutdown handler de-registered
function_muhik_2024-12-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
function_muhik_2024-12-18 status is now inactive due to admin request