developer_uid: rirv938
submission_id: function_kifem_2025-05-22
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-05-22T17:03:32+00:00
num_battles: 8545
num_wins: 4219
celo_rating: 1290.49
family_friendly_score: 0.5347999999999999
family_friendly_standard_error: 0.007053920328441483
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-22
win_ratio: 0.49373902867173786
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.42720365524292s
Received healthy response to inference request in 3.0786702632904053s
Received healthy response to inference request in 3.290407657623291s
Received healthy response to inference request in 2.844287157058716s
Received healthy response to inference request in 16.729387998580933s
5 requests
0 failed requests
5th percentile: 2.891163778305054
10th percentile: 2.9380403995513915
20th percentile: 3.031793642044067
30th percentile: 3.1210177421569822
40th percentile: 3.2057126998901366
50th percentile: 3.290407657623291
60th percentile: 3.3451260566711425
70th percentile: 3.399844455718994
80th percentile: 6.087640523910524
90th percentile: 11.408514261245728
95th percentile: 14.068951129913328
99th percentile: 16.19730062484741
mean time: 5.873991346359253
Pipeline stage StressChecker completed in 30.52s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.66s
Shutdown handler de-registered
function_kifem_2025-05-22 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4480.22s
Shutdown handler de-registered
function_kifem_2025-05-22 status is now inactive due to auto deactivation removed underperforming models
function_kifem_2025-05-22 status is now torndown due to DeploymentManager action