developer_uid: chai_backend_admin
submission_id: function_domum_2025-05-19
model_name: function_domum_2025-05-19
model_group:
status: torndown
timestamp: 2025-05-19T05:14:53+00:00
num_battles: 7499
num_wins: 3846
celo_rating: 1293.37
family_friendly_score: 0.531
family_friendly_standard_error: 0.00705746413380897
submission_type: function
display_name: function_domum_2025-05-19
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-05-18
win_ratio: 0.5128683824509934
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.5322375297546387s
Received healthy response to inference request in 4.127803087234497s
Received healthy response to inference request in 3.3197970390319824s
Received healthy response to inference request in 3.508221387863159s
Failed to get response for submission chaiml-felix-mafia-gang-_5653_v2: HTTPConnectionPool(host='chaiml-felix-mafia-gang-5653-v2-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 3.419717311859131s
5 requests
0 failed requests
5th percentile: 2.6897494316101076
10th percentile: 2.847261333465576
20th percentile: 3.1622851371765135
30th percentile: 3.339781093597412
40th percentile: 3.3797492027282714
50th percentile: 3.419717311859131
60th percentile: 3.455118942260742
70th percentile: 3.4905205726623536
80th percentile: 3.632137727737427
90th percentile: 3.879970407485962
95th percentile: 4.003886747360229
99th percentile: 4.103019819259644
mean time: 3.381555271148682
Pipeline stage StressChecker completed in 18.08s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.69s
Shutdown handler de-registered
function_domum_2025-05-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3205.47s
Shutdown handler de-registered
function_domum_2025-05-19 status is now inactive due to auto deactivation removed underperforming models
function_domum_2025-05-19 status is now torndown due to DeploymentManager action