developer_uid: rirv938
submission_id: function_libuf_2025-04-10
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-04-10T18:31:07+00:00
num_battles: 7999
num_wins: 4623
celo_rating: 1336.67
family_friendly_score: 0.5127999999999999
family_friendly_standard_error: 0.007068750384615374
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-10
win_ratio: 0.5779472434054257
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.048596382141113s
Received healthy response to inference request in 5.456338167190552s
Received healthy response to inference request in 5.558027982711792s
Received healthy response to inference request in 8.281541347503662s
Received healthy response to inference request in 3.8618738651275635s
5 requests
0 failed requests
5th percentile: 4.1807667255401615
10th percentile: 4.499659585952759
20th percentile: 5.137445306777954
30th percentile: 5.4766761302948
40th percentile: 5.517352056503296
50th percentile: 5.558027982711792
60th percentile: 5.75425534248352
70th percentile: 5.950482702255249
80th percentile: 6.495185375213623
90th percentile: 7.388363361358643
95th percentile: 7.834952354431152
99th percentile: 8.19222354888916
mean time: 5.841275548934936
Pipeline stage StressChecker completed in 30.84s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.06s
Shutdown handler de-registered
function_libuf_2025-04-10 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4456.09s
Shutdown handler de-registered
function_libuf_2025-04-10 status is now inactive due to auto deactivation removed underperforming models
function_libuf_2025-04-10 status is now torndown due to DeploymentManager action