developer_uid: rirv938
submission_id: function_lepab_2025-03-14
model_name: dpo_data_collection
model_group:
status: deployed
timestamp: 2025-03-14T18:26:04+00:00
num_battles: 0
num_wins: 0
family_friendly_score: 0.5298
family_friendly_standard_error: 0.007058497857193129
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-03-14
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.4721734523773193s
Received healthy response to inference request in 3.891585111618042s
Received healthy response to inference request in 4.796694040298462s
Received healthy response to inference request in 4.732717037200928s
Received healthy response to inference request in 4.634551525115967s
5 requests
0 failed requests
5th percentile: 3.556055784225464
10th percentile: 3.6399381160736084
20th percentile: 3.8077027797698975
30th percentile: 4.040178394317627
40th percentile: 4.337364959716797
50th percentile: 4.634551525115967
60th percentile: 4.673817729949951
70th percentile: 4.713083934783936
80th percentile: 4.745512437820435
90th percentile: 4.771103239059448
95th percentile: 4.783898639678955
99th percentile: 4.794134960174561
mean time: 4.305544233322143
%s, retrying in %s seconds...
Received healthy response to inference request in 3.5986409187316895s
Received healthy response to inference request in 3.2933106422424316s
Received healthy response to inference request in 2.5044169425964355s
Received healthy response to inference request in 4.766348123550415s
Received healthy response to inference request in 3.0412516593933105s
5 requests
0 failed requests
5th percentile: 2.6117838859558105
10th percentile: 2.7191508293151854
20th percentile: 2.9338847160339356
30th percentile: 3.091663455963135
40th percentile: 3.192487049102783
50th percentile: 3.2933106422424316
60th percentile: 3.4154427528381346
70th percentile: 3.537574863433838
80th percentile: 3.8321823596954347
90th percentile: 4.2992652416229244
95th percentile: 4.53280668258667
99th percentile: 4.719639835357666
mean time: 3.4407936573028564
Pipeline stage StressChecker completed in 41.09s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.72s
Shutdown handler de-registered
function_lepab_2025-03-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3297.52s
Shutdown handler de-registered
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1