developer_uid: rirv938
submission_id: function_heron_2025-04-09
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-04-09T22:00:05+00:00
num_battles: 5323
num_wins: 3158
celo_rating: 1341.54
family_friendly_score: 0.5588
family_friendly_standard_error: 0.007022001993733695
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-09
win_ratio: 0.5932744692842382
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.6910641193389893s
Received healthy response to inference request in 3.7530789375305176s
Received healthy response to inference request in 3.9931704998016357s
Received healthy response to inference request in 4.007515907287598s
Received healthy response to inference request in 3.8599634170532227s
5 requests
0 failed requests
5th percentile: 2.903467082977295
10th percentile: 3.1158700466156004
20th percentile: 3.540675973892212
30th percentile: 3.7744558334350584
40th percentile: 3.8172096252441405
50th percentile: 3.8599634170532227
60th percentile: 3.913246250152588
70th percentile: 3.9665290832519533
80th percentile: 3.9960395812988283
90th percentile: 4.0017777442932125
95th percentile: 4.004646825790405
99th percentile: 4.006942090988159
mean time: 3.6609585762023924
%s, retrying in %s seconds...
Received healthy response to inference request in 3.422995090484619s
Received healthy response to inference request in 3.1237027645111084s
Received healthy response to inference request in 3.906968355178833s
Received healthy response to inference request in 2.9314308166503906s
Received healthy response to inference request in 3.285399913787842s
5 requests
0 failed requests
5th percentile: 2.9698852062225343
10th percentile: 3.008339595794678
20th percentile: 3.0852483749389648
30th percentile: 3.156042194366455
40th percentile: 3.2207210540771483
50th percentile: 3.285399913787842
60th percentile: 3.340437984466553
70th percentile: 3.395476055145264
80th percentile: 3.519789743423462
90th percentile: 3.7133790493011474
95th percentile: 3.81017370223999
99th percentile: 3.8876094245910644
mean time: 3.3340993881225587
Pipeline stage StressChecker completed in 37.24s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.69s
Shutdown handler de-registered
function_heron_2025-04-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3153.53s
Shutdown handler de-registered
function_heron_2025-04-09 status is now inactive due to auto deactivation removed underperforming models
function_heron_2025-04-09 status is now torndown due to DeploymentManager action