developer_uid: rirv938
submission_id: function_gihor_2025-04-18
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-04-18T18:29:52+00:00
num_battles: 7979
num_wins: 4301
celo_rating: 1297.24
family_friendly_score: 0.5398000000000001
family_friendly_standard_error: 0.0070486305052825686
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-18
win_ratio: 0.5390399799473619
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3382198810577393s
Received healthy response to inference request in 2.812063217163086s
Received healthy response to inference request in 3.95961332321167s
Received healthy response to inference request in 2.961129665374756s
Received healthy response to inference request in 4.363165616989136s
5 requests
0 failed requests
5th percentile: 2.4329885482788085
10th percentile: 2.5277572154998778
20th percentile: 2.7172945499420167
30th percentile: 2.84187650680542
40th percentile: 2.901503086090088
50th percentile: 2.961129665374756
60th percentile: 3.3605231285095214
70th percentile: 3.759916591644287
80th percentile: 4.040323781967163
90th percentile: 4.20174469947815
95th percentile: 4.282455158233643
99th percentile: 4.347023525238037
mean time: 3.286838340759277
%s, retrying in %s seconds...
Received healthy response to inference request in 4.163883209228516s
Received healthy response to inference request in 4.53742790222168s
Received healthy response to inference request in 5.167378187179565s
Received healthy response to inference request in 3.0574612617492676s
Received healthy response to inference request in 2.906358003616333s
5 requests
0 failed requests
5th percentile: 2.93657865524292
10th percentile: 2.9667993068695067
20th percentile: 3.0272406101226808
30th percentile: 3.278745651245117
40th percentile: 3.7213144302368164
50th percentile: 4.163883209228516
60th percentile: 4.313301086425781
70th percentile: 4.462718963623047
80th percentile: 4.663417959213257
90th percentile: 4.915398073196411
95th percentile: 5.041388130187988
99th percentile: 5.14218017578125
mean time: 3.9665017127990723
%s, retrying in %s seconds...
Received healthy response to inference request in 3.4709415435791016s
Received healthy response to inference request in 2.5215561389923096s
Received healthy response to inference request in 1.9688231945037842s
Received healthy response to inference request in 3.733438730239868s
Received healthy response to inference request in 6.442713499069214s
5 requests
0 failed requests
5th percentile: 2.0793697834014893
10th percentile: 2.1899163722991943
20th percentile: 2.4110095500946045
30th percentile: 2.711433219909668
40th percentile: 3.0911873817443847
50th percentile: 3.4709415435791016
60th percentile: 3.575940418243408
70th percentile: 3.680939292907715
80th percentile: 4.275293684005738
90th percentile: 5.359003591537476
95th percentile: 5.900858545303344
99th percentile: 6.33434250831604
mean time: 3.6274946212768553
Pipeline stage StressChecker completed in 57.55s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.69s
Shutdown handler de-registered
function_gihor_2025-04-18 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4343.04s
Shutdown handler de-registered
function_gihor_2025-04-18 status is now inactive due to auto deactivation removed underperforming models
function_gihor_2025-04-18 status is now torndown due to DeploymentManager action