developer_uid: chai_backend_admin
submission_id: function_hojar_2025-07-29
model_name: function_hojar_2025-07-29
model_group:
status: torndown
timestamp: 2025-07-29T23:06:08+00:00
num_battles: 5416
num_wins: 2790
celo_rating: 1289.77
family_friendly_score: 0.0
family_friendly_standard_error: 0.0
submission_type: function
display_name: function_hojar_2025-07-29
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-07-29
win_ratio: 0.5151403249630724
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Failed to get response for submission chaiml-grpo-nis-12bsftg_71959_v4: HTTPConnectionPool(host='chaiml-grpo-nis-12bsftg-71959-v4-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 4.578358173370361s
Received healthy response to inference request in 2.1835129261016846s
Received healthy response to inference request in 3.9262759685516357s
Received healthy response to inference request in 3.5563597679138184s
Received healthy response to inference request in 4.290151834487915s
5 requests
0 failed requests
5th percentile: 2.4580822944641114
10th percentile: 2.7326516628265383
20th percentile: 3.2817903995513915
30th percentile: 3.6303430080413817
40th percentile: 3.7783094882965087
50th percentile: 3.9262759685516357
60th percentile: 4.071826314926147
70th percentile: 4.217376661300659
80th percentile: 4.347793102264404
90th percentile: 4.463075637817383
95th percentile: 4.520716905593872
99th percentile: 4.5668299198150635
mean time: 3.706931734085083
%s, retrying in %s seconds...
Received healthy response to inference request in 3.0187606811523438s
Received healthy response to inference request in 3.914670944213867s
Received healthy response to inference request in 3.356459856033325s
Received healthy response to inference request in 2.361398220062256s
Received healthy response to inference request in 2.153069257736206s
5 requests
0 failed requests
5th percentile: 2.194735050201416
10th percentile: 2.236400842666626
20th percentile: 2.319732427597046
30th percentile: 2.4928707122802733
40th percentile: 2.7558156967163088
50th percentile: 3.0187606811523438
60th percentile: 3.153840351104736
70th percentile: 3.288920021057129
80th percentile: 3.4681020736694337
90th percentile: 3.69138650894165
95th percentile: 3.8030287265777587
99th percentile: 3.8923425006866457
mean time: 2.9608717918395997
Pipeline stage StressChecker completed in 35.79s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.35s
Shutdown handler de-registered
function_hojar_2025-07-29 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
Received signal 15, running shutdown handler
Shutdown handler de-registered
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
%s, retrying in %s seconds...
Evaluating %s Family Friendly Score with %s threads
clean up pipeline due to error=DeploymentChecksError('None: None')
Shutdown handler de-registered
function_hojar_2025-07-29 status is now inactive due to auto deactivation removed underperforming models
function_hojar_2025-07-29 status is now torndown due to DeploymentManager action