developer_uid: rirv938
submission_id: function_dekom_2025-03-13
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-03-13T21:25:34+00:00
num_battles: 0
num_wins: 0
family_friendly_score: 0.5274
family_friendly_standard_error: 0.007060442479051862
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-03-13
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 6.418447017669678s
Received healthy response to inference request in 6.2787816524505615s
Received healthy response to inference request in 4.636155605316162s
Received healthy response to inference request in 2.3945987224578857s
Received healthy response to inference request in 2.760817766189575s
5 requests
0 failed requests
5th percentile: 2.467842531204224
10th percentile: 2.5410863399505614
20th percentile: 2.687573957443237
30th percentile: 3.1358853340148927
40th percentile: 3.8860204696655276
50th percentile: 4.636155605316162
60th percentile: 5.293206024169922
70th percentile: 5.950256443023681
80th percentile: 6.306714725494385
90th percentile: 6.362580871582031
95th percentile: 6.390513944625854
99th percentile: 6.412860403060913
mean time: 4.497760152816772
%s, retrying in %s seconds...
Received healthy response to inference request in 2.840522289276123s
Received healthy response to inference request in 3.072937250137329s
Received healthy response to inference request in 2.648068904876709s
Received healthy response to inference request in 3.3744354248046875s
Received healthy response to inference request in 4.724097490310669s
5 requests
0 failed requests
5th percentile: 2.6865595817565917
10th percentile: 2.7250502586364744
20th percentile: 2.8020316123962403
30th percentile: 2.8870052814483644
40th percentile: 2.9799712657928468
50th percentile: 3.072937250137329
60th percentile: 3.1935365200042725
70th percentile: 3.314135789871216
80th percentile: 3.644367837905884
90th percentile: 4.1842326641082765
95th percentile: 4.454165077209472
99th percentile: 4.67011100769043
mean time: 3.3320122718811036
Pipeline stage StressChecker completed in 41.25s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.67s
Shutdown handler de-registered
function_dekom_2025-03-13 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3172.56s
Shutdown handler de-registered
function_dekom_2025-03-13 status is now torndown due to DeploymentManager action
ChatRequest
Generation Params
Prompt Formatter
Chat History
ChatMessage 1