developer_uid: rirv938
submission_id: function_pafok_2025-04-11
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-04-11T17:47:47+00:00
num_battles: 8891
num_wins: 4824
celo_rating: 1316.6
family_friendly_score: 0.6484
family_friendly_standard_error: 0.006752443113421986
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-11
win_ratio: 0.5425711393544034
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.7612860202789307s
Received healthy response to inference request in 2.9847700595855713s
Received healthy response to inference request in 4.366030931472778s
Received healthy response to inference request in 3.9668853282928467s
Received healthy response to inference request in 3.3821024894714355s
5 requests
0 failed requests
5th percentile: 2.805982828140259
10th percentile: 2.850679636001587
20th percentile: 2.940073251724243
30th percentile: 3.064236545562744
40th percentile: 3.22316951751709
50th percentile: 3.3821024894714355
60th percentile: 3.616015625
70th percentile: 3.8499287605285644
80th percentile: 4.046714448928833
90th percentile: 4.206372690200806
95th percentile: 4.286201810836792
99th percentile: 4.350065107345581
mean time: 3.4922149658203123
%s, retrying in %s seconds...
Received healthy response to inference request in 3.4924466609954834s
Received healthy response to inference request in 3.696836233139038s
Received healthy response to inference request in 3.2192046642303467s
Received healthy response to inference request in 5.478108882904053s
Received healthy response to inference request in 2.544177293777466s
5 requests
0 failed requests
5th percentile: 2.679182767868042
10th percentile: 2.814188241958618
20th percentile: 3.0841991901397705
30th percentile: 3.273853063583374
40th percentile: 3.3831498622894287
50th percentile: 3.4924466609954834
60th percentile: 3.5742024898529055
70th percentile: 3.655958318710327
80th percentile: 4.053090763092041
90th percentile: 4.765599822998047
95th percentile: 5.12185435295105
99th percentile: 5.406857976913452
mean time: 3.6861547470092773
Pipeline stage StressChecker completed in 38.37s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_pafok_2025-04-11 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4169.10s
Shutdown handler de-registered
function_pafok_2025-04-11 status is now inactive due to auto deactivation removed underperforming models
function_pafok_2025-04-11 status is now torndown due to DeploymentManager action