developer_uid: rirv938
submission_id: function_fakab_2025-03-14
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-03-14T18:28:12+00:00
num_battles: 0
num_wins: 0
family_friendly_score: 0.5247999999999999
family_friendly_standard_error: 0.007062364476575816
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-03-14
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5990519523620605s
Received healthy response to inference request in 3.221071481704712s
Received healthy response to inference request in 4.1429970264434814s
Received healthy response to inference request in 4.830106735229492s
Received healthy response to inference request in 3.386577844619751s
5 requests
0 failed requests
5th percentile: 2.723455858230591
10th percentile: 2.847859764099121
20th percentile: 3.0966675758361815
30th percentile: 3.25417275428772
40th percentile: 3.3203752994537354
50th percentile: 3.386577844619751
60th percentile: 3.6891455173492433
70th percentile: 3.9917131900787353
80th percentile: 4.280418968200684
90th percentile: 4.555262851715088
95th percentile: 4.6926847934722895
99th percentile: 4.802622346878052
mean time: 3.6359610080718996
%s, retrying in %s seconds...
Received healthy response to inference request in 3.379122734069824s
Received healthy response to inference request in 2.6273887157440186s
Received healthy response to inference request in 2.7864840030670166s
Received healthy response to inference request in 2.6438586711883545s
Received healthy response to inference request in 2.178755283355713s
5 requests
0 failed requests
5th percentile: 2.268481969833374
10th percentile: 2.358208656311035
20th percentile: 2.5376620292663574
30th percentile: 2.6306827068328857
40th percentile: 2.63727068901062
50th percentile: 2.6438586711883545
60th percentile: 2.7009088039398192
70th percentile: 2.757958936691284
80th percentile: 2.905011749267578
90th percentile: 3.142067241668701
95th percentile: 3.2605949878692626
99th percentile: 3.355417184829712
mean time: 2.7231218814849854
Pipeline stage StressChecker completed in 34.22s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.77s
Shutdown handler de-registered
function_fakab_2025-03-14 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3299.60s
Shutdown handler de-registered
function_fakab_2025-03-14 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1