developer_uid: rirv938
submission_id: function_pabut_2025-06-25
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-06-25T03:46:10+00:00
num_battles: 7175
num_wins: 3699
celo_rating: 1285.03
family_friendly_score: 0.5394
family_friendly_standard_error: 0.007049079939963797
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-06-24
win_ratio: 0.5155400696864112
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.504875898361206s
Received healthy response to inference request in 5.122245788574219s
Received healthy response to inference request in 3.899751663208008s
Received healthy response to inference request in 5.7184062004089355s
Received healthy response to inference request in 5.569482088088989s
5 requests
0 failed requests
5th percentile: 2.7838510513305663
10th percentile: 3.0628262042999266
20th percentile: 3.6207765102386475
30th percentile: 4.14425048828125
40th percentile: 4.633248138427734
50th percentile: 5.122245788574219
60th percentile: 5.301140308380127
70th percentile: 5.480034828186035
80th percentile: 5.599266910552979
90th percentile: 5.658836555480957
95th percentile: 5.688621377944946
99th percentile: 5.712449235916138
mean time: 4.562952327728271
%s, retrying in %s seconds...
Received healthy response to inference request in 2.756608486175537s
Received healthy response to inference request in 2.9218554496765137s
Received healthy response to inference request in 6.402209997177124s
Received healthy response to inference request in 3.0039398670196533s
Received healthy response to inference request in 5.158472061157227s
5 requests
0 failed requests
5th percentile: 2.7896578788757322
10th percentile: 2.822707271575928
20th percentile: 2.8888060569763185
30th percentile: 2.9382723331451417
40th percentile: 2.9711061000823973
50th percentile: 3.0039398670196533
60th percentile: 3.8657527446746824
70th percentile: 4.727565622329712
80th percentile: 5.407219648361206
90th percentile: 5.904714822769165
95th percentile: 6.1534624099731445
99th percentile: 6.352460479736328
mean time: 4.048617172241211
%s, retrying in %s seconds...
Received healthy response to inference request in 2.557454824447632s
Received healthy response to inference request in 3.1407344341278076s
Received healthy response to inference request in 3.7084693908691406s
Received healthy response to inference request in 3.3652396202087402s
Received healthy response to inference request in 2.611429214477539s
5 requests
0 failed requests
5th percentile: 2.5682497024536133
10th percentile: 2.5790445804595947
20th percentile: 2.6006343364715576
30th percentile: 2.717290258407593
40th percentile: 2.9290123462677
50th percentile: 3.1407344341278076
60th percentile: 3.2305365085601805
70th percentile: 3.320338582992554
80th percentile: 3.4338855743408203
90th percentile: 3.5711774826049805
95th percentile: 3.6398234367370605
99th percentile: 3.6947402000427245
mean time: 3.076665496826172
Pipeline stage StressChecker completed in 62.12s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.91s
Shutdown handler de-registered
function_pabut_2025-06-25 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3431.65s
Shutdown handler de-registered
function_pabut_2025-06-25 status is now inactive due to auto deactivation removed underperforming models
function_pabut_2025-06-25 status is now torndown due to DeploymentManager action