developer_uid: rirv938
submission_id: function_binot_2025-05-28
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-05-28T17:27:03+00:00
num_battles: 8296
num_wins: 4140
celo_rating: 1286.7
family_friendly_score: 0.5422
family_friendly_standard_error: 0.007045837920361212
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-28
win_ratio: 0.4990356798457088
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.2083234786987305s
Received healthy response to inference request in 4.106427192687988s
Received healthy response to inference request in 3.5052289962768555s
Received healthy response to inference request in 3.954740285873413s
Received healthy response to inference request in 3.352977991104126s
5 requests
0 failed requests
5th percentile: 3.2372543811798096
10th percentile: 3.2661852836608887
20th percentile: 3.324047088623047
30th percentile: 3.383428192138672
40th percentile: 3.4443285942077635
50th percentile: 3.5052289962768555
60th percentile: 3.6850335121154787
70th percentile: 3.8648380279541015
80th percentile: 3.985077667236328
90th percentile: 4.045752429962159
95th percentile: 4.076089811325073
99th percentile: 4.100359716415405
mean time: 3.6255395889282225
%s, retrying in %s seconds...
Received healthy response to inference request in 3.8558545112609863s
Received healthy response to inference request in 3.7653002738952637s
Received healthy response to inference request in 5.132867097854614s
Received healthy response to inference request in 2.7764551639556885s
Received healthy response to inference request in 3.5640368461608887s
5 requests
0 failed requests
5th percentile: 2.9339715003967286
10th percentile: 3.0914878368377687
20th percentile: 3.4065205097198485
30th percentile: 3.6042895317077637
40th percentile: 3.6847949028015137
50th percentile: 3.7653002738952637
60th percentile: 3.801521968841553
70th percentile: 3.8377436637878417
80th percentile: 4.111257028579712
90th percentile: 4.622062063217163
95th percentile: 4.8774645805358885
99th percentile: 5.081786594390869
mean time: 3.818902778625488
%s, retrying in %s seconds...
Received healthy response to inference request in 2.9904944896698s
Received healthy response to inference request in 2.8119239807128906s
Received healthy response to inference request in 2.9375345706939697s
Received healthy response to inference request in 3.36854887008667s
Received healthy response to inference request in 2.999769687652588s
5 requests
0 failed requests
5th percentile: 2.8370460987091066
10th percentile: 2.862168216705322
20th percentile: 2.9124124526977537
30th percentile: 2.9481265544891357
40th percentile: 2.9693105220794678
50th percentile: 2.9904944896698
60th percentile: 2.994204568862915
70th percentile: 2.9979146480560304
80th percentile: 3.0735255241394044
90th percentile: 3.221037197113037
95th percentile: 3.2947930335998534
99th percentile: 3.3537977027893064
mean time: 3.0216543197631838
Pipeline stage StressChecker completed in 55.83s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.61s
Shutdown handler de-registered
function_binot_2025-05-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3442.14s
Shutdown handler de-registered
function_binot_2025-05-28 status is now inactive due to auto deactivation removed underperforming models
function_binot_2025-05-28 status is now torndown due to DeploymentManager action