developer_uid: rirv938
submission_id: function_sorub_2025-04-03
model_name: dpo_data_collection
model_group:
status: inactive
timestamp: 2025-04-03T20:14:25+00:00
num_battles: 7378
num_wins: 3833
celo_rating: 1320.65
family_friendly_score: 0.5469999999999999
family_friendly_standard_error: 0.007039758518585705
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-03
win_ratio: 0.5195174844131201
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8744211196899414s
Received healthy response to inference request in 2.4219977855682373s
Received healthy response to inference request in 2.7647128105163574s
Received healthy response to inference request in 3.726950168609619s
Received healthy response to inference request in 3.1720669269561768s
5 requests
0 failed requests
5th percentile: 2.490540790557861
10th percentile: 2.5590837955474854
20th percentile: 2.6961698055267336
30th percentile: 2.786654472351074
40th percentile: 2.830537796020508
50th percentile: 2.8744211196899414
60th percentile: 2.9934794425964357
70th percentile: 3.1125377655029296
80th percentile: 3.2830435752868654
90th percentile: 3.5049968719482423
95th percentile: 3.6159735202789305
99th percentile: 3.7047548389434812
mean time: 2.9920297622680665
Pipeline stage StressChecker completed in 16.00s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.62s
Shutdown handler de-registered
function_sorub_2025-04-03 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3425.22s
Shutdown handler de-registered
function_sorub_2025-04-03 status is now inactive due to auto deactivation removed underperforming models
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1