developer_uid: rirv938
submission_id: function_metal_2025-05-28
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-05-28T17:18:24+00:00
num_battles: 9467
num_wins: 4779
celo_rating: 1289.97
family_friendly_score: 0.5429999999999999
family_friendly_standard_error: 0.007044870474323854
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-28
win_ratio: 0.5048061687968733
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.412889003753662s
Received healthy response to inference request in 3.9093008041381836s
Received healthy response to inference request in 3.4747467041015625s
Received healthy response to inference request in 4.622270345687866s
Received healthy response to inference request in 4.709644794464111s
5 requests
0 failed requests
5th percentile: 3.425260543823242
10th percentile: 3.4376320838928223
20th percentile: 3.4623751640319824
30th percentile: 3.561657524108887
40th percentile: 3.735479164123535
50th percentile: 3.9093008041381836
60th percentile: 4.194488620758056
70th percentile: 4.47967643737793
80th percentile: 4.639745235443115
90th percentile: 4.674695014953613
95th percentile: 4.692169904708862
99th percentile: 4.7061498165130615
mean time: 4.0257703304290775
%s, retrying in %s seconds...
Received healthy response to inference request in 3.049748659133911s
Received healthy response to inference request in 2.523129940032959s
Received healthy response to inference request in 3.4532625675201416s
Received healthy response to inference request in 5.558428525924683s
Received healthy response to inference request in 3.2663867473602295s
5 requests
0 failed requests
5th percentile: 2.6284536838531496
10th percentile: 2.7337774276733398
20th percentile: 2.9444249153137205
30th percentile: 3.0930762767791746
40th percentile: 3.179731512069702
50th percentile: 3.2663867473602295
60th percentile: 3.3411370754241942
70th percentile: 3.415887403488159
80th percentile: 3.87429575920105
90th percentile: 4.716362142562867
95th percentile: 5.137395334243774
99th percentile: 5.4742218875885005
mean time: 3.5701912879943847
Pipeline stage StressChecker completed in 40.01s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.60s
Shutdown handler de-registered
function_metal_2025-05-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3489.18s
Shutdown handler de-registered
function_metal_2025-05-28 status is now inactive due to auto deactivation removed underperforming models
function_metal_2025-05-28 status is now torndown due to DeploymentManager action