developer_uid: rirv938
submission_id: function_mesam_2025-05-22
model_name: dpo_data_collection
model_group:
status: torndown
timestamp: 2025-05-22T01:12:22+00:00
num_battles: 5409
num_wins: 2763
celo_rating: 1295.74
family_friendly_score: 0.5408
family_friendly_standard_error: 0.007047486927976525
submission_type: function
display_name: dpo_data_collection
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-21
win_ratio: 0.5108153078202995
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['</s>', '\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.27092719078064s
Received healthy response to inference request in 2.693192958831787s
Received healthy response to inference request in 3.221869945526123s
Received healthy response to inference request in 2.3858706951141357s
Received healthy response to inference request in 2.643787145614624s
5 requests
0 failed requests
5th percentile: 2.4374539852142334
10th percentile: 2.489037275314331
20th percentile: 2.5922038555145264
30th percentile: 2.6536683082580566
40th percentile: 2.673430633544922
50th percentile: 2.693192958831787
60th percentile: 2.9046637535095217
70th percentile: 3.1161345481872558
80th percentile: 3.4316813945770264
90th percentile: 3.851304292678833
95th percentile: 4.061115741729736
99th percentile: 4.228964900970459
mean time: 3.043129587173462
Pipeline stage StressChecker completed in 17.67s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_mesam_2025-05-22 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 2922.28s
Shutdown handler de-registered
function_mesam_2025-05-22 status is now inactive due to auto deactivation removed underperforming models
function_mesam_2025-05-22 status is now torndown due to DeploymentManager action