developer_uid: rirv938
submission_id: function_befuf_2025-04-18
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-04-18T18:27:35+00:00
num_battles: 7203
num_wins: 3969
celo_rating: 1305.72
family_friendly_score: 0.5544
family_friendly_standard_error: 0.0070290915486995904
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-18
win_ratio: 0.5510204081632653
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.3932042121887207s
Received healthy response to inference request in 3.139493942260742s
Received healthy response to inference request in 2.359710931777954s
Received healthy response to inference request in 3.849062442779541s
Received healthy response to inference request in 5.0976550579071045s
5 requests
0 failed requests
5th percentile: 2.515667533874512
10th percentile: 2.6716241359710695
20th percentile: 2.9835373401641845
30th percentile: 3.190235996246338
40th percentile: 3.2917201042175295
50th percentile: 3.3932042121887207
60th percentile: 3.5755475044250487
70th percentile: 3.757890796661377
80th percentile: 4.098780965805054
90th percentile: 4.598218011856079
95th percentile: 4.847936534881591
99th percentile: 5.0477113533020015
mean time: 3.5678253173828125
%s, retrying in %s seconds...
Received healthy response to inference request in 2.4490716457366943s
Received healthy response to inference request in 2.727567672729492s
Received healthy response to inference request in 4.057230234146118s
Received healthy response to inference request in 3.2654004096984863s
Received healthy response to inference request in 2.462545156478882s
5 requests
0 failed requests
5th percentile: 2.451766347885132
10th percentile: 2.4544610500335695
20th percentile: 2.4598504543304442
30th percentile: 2.515549659729004
40th percentile: 2.621558666229248
50th percentile: 2.727567672729492
60th percentile: 2.9427007675170898
70th percentile: 3.1578338623046873
80th percentile: 3.4237663745880127
90th percentile: 3.7404983043670654
95th percentile: 3.898864269256592
99th percentile: 4.025557041168213
mean time: 2.9923630237579344
Pipeline stage StressChecker completed in 34.92s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
function_befuf_2025-04-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4236.61s
Shutdown handler de-registered
function_befuf_2025-04-18 status is now inactive due to auto deactivation removed underperforming models
function_befuf_2025-04-18 status is now torndown due to DeploymentManager action