developer_uid: chai_backend_admin
submission_id: function_dedem_2025-04-28
model_name: function_dedem_2025-04-28
model_group:
status: torndown
timestamp: 2025-04-28T23:49:46+00:00
num_battles: 6424
num_wins: 3158
celo_rating: 1278.22
family_friendly_score: 0.4982
family_friendly_standard_error: 0.007071021991197595
submission_type: function
display_name: function_dedem_2025-04-28
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-28
win_ratio: 0.49159402241594025
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.3471639156341553s
Received healthy response to inference request in 2.403820037841797s
Received healthy response to inference request in 2.3155667781829834s
Received healthy response to inference request in 2.453181028366089s
Received healthy response to inference request in 2.6094014644622803s
5 requests
0 failed requests
5th percentile: 2.3218862056732177
10th percentile: 2.328205633163452
20th percentile: 2.340844488143921
30th percentile: 2.3584951400756835
40th percentile: 2.3811575889587404
50th percentile: 2.403820037841797
60th percentile: 2.4235644340515137
70th percentile: 2.4433088302612305
80th percentile: 2.484425115585327
90th percentile: 2.5469132900238036
95th percentile: 2.578157377243042
99th percentile: 2.6031526470184327
mean time: 2.425826644897461
Pipeline stage StressChecker completed in 13.41s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.65s
Shutdown handler de-registered
function_dedem_2025-04-28 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3395.36s
Shutdown handler de-registered
function_dedem_2025-04-28 status is now inactive due to auto deactivation removed underperforming models
function_dedem_2025-04-28 status is now torndown due to DeploymentManager action