developer_uid: rirv938
submission_id: function_kakal_2025-05-22
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-05-22T00:43:41+00:00
num_battles: 6322
num_wins: 3213
celo_rating: 1290.19
family_friendly_score: 0.5316000000000001
family_friendly_standard_error: 0.007056931911248684
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-21
win_ratio: 0.5082252451755773
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.6648709774017334s
Received healthy response to inference request in 3.055633306503296s
Received healthy response to inference request in 2.9030990600585938s
Received healthy response to inference request in 3.1206514835357666s
Received healthy response to inference request in 3.2089710235595703s
5 requests
0 failed requests
5th percentile: 2.7125165939331053
10th percentile: 2.7601622104644776
20th percentile: 2.855453443527222
30th percentile: 2.933605909347534
40th percentile: 2.994619607925415
50th percentile: 3.055633306503296
60th percentile: 3.0816405773162843
70th percentile: 3.1076478481292726
80th percentile: 3.1383153915405275
90th percentile: 3.173643207550049
95th percentile: 3.1913071155548094
99th percentile: 3.205438241958618
mean time: 2.990645170211792
Pipeline stage StressChecker completed in 16.00s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.71s
Shutdown handler de-registered
function_kakal_2025-05-22 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2869.73s
Shutdown handler de-registered
function_kakal_2025-05-22 status is now inactive due to auto deactivation removed underperforming models
function_kakal_2025-05-22 status is now torndown due to DeploymentManager action