developer_uid: chai_backend_admin
submission_id: function_burul_2025-04-26
model_name: function_burul_2025-04-26
model_group:
status: torndown
timestamp: 2025-04-26T07:27:40+00:00
num_battles: 9242
num_wins: 4399
celo_rating: 1272.43
family_friendly_score: 0.5546
family_friendly_standard_error: 0.007028781402206217
submission_type: function
display_name: function_burul_2025-04-26
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-26
win_ratio: 0.4759792252759143
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 2.8436081409454346s
Received healthy response to inference request in 3.67868971824646s
Received healthy response to inference request in 3.91916561126709s
Received healthy response to inference request in 2.498995304107666s
Received healthy response to inference request in 5.363123893737793s
5 requests
0 failed requests
5th percentile: 2.5679178714752195
10th percentile: 2.6368404388427735
20th percentile: 2.774685573577881
30th percentile: 3.0106244564056395
40th percentile: 3.3446570873260497
50th percentile: 3.67868971824646
60th percentile: 3.774880075454712
70th percentile: 3.8710704326629637
80th percentile: 4.2079572677612305
90th percentile: 4.785540580749512
95th percentile: 5.074332237243652
99th percentile: 5.305365562438965
mean time: 3.6607165336608887
%s, retrying in %s seconds...
Received healthy response to inference request in 2.7125208377838135s
Failed to get response for submission rirv938-grpo-to-compare_36740_v1: HTTPConnectionPool(host='rirv938-grpo-to-compare-36740-v1-predictor.tenant-chaiml-guanaco.k.chaiverse.com', port=80): Read timed out. (read timeout=12.0)
Received healthy response to inference request in 8.97048020362854s
Received healthy response to inference request in 2.6703953742980957s
Received healthy response to inference request in 3.144804000854492s
Received healthy response to inference request in 4.482430458068848s
5 requests
0 failed requests
5th percentile: 2.6788204669952393
10th percentile: 2.687245559692383
20th percentile: 2.70409574508667
30th percentile: 2.7989774703979493
40th percentile: 2.9718907356262205
50th percentile: 3.144804000854492
60th percentile: 3.679854583740234
70th percentile: 4.214905166625976
80th percentile: 5.380040407180787
90th percentile: 7.175260305404663
95th percentile: 8.072870254516602
99th percentile: 8.790958213806153
mean time: 4.396126174926758
%s, retrying in %s seconds...
Received healthy response to inference request in 2.5921778678894043s
Received healthy response to inference request in 4.409643888473511s
Received healthy response to inference request in 3.3699569702148438s
Received healthy response to inference request in 2.4689550399780273s
Received healthy response to inference request in 3.4728076457977295s
5 requests
0 failed requests
5th percentile: 2.493599605560303
10th percentile: 2.518244171142578
20th percentile: 2.5675333023071287
30th percentile: 2.7477336883544923
40th percentile: 3.058845329284668
50th percentile: 3.3699569702148438
60th percentile: 3.4110972404479982
70th percentile: 3.4522375106811523
80th percentile: 3.660174894332886
90th percentile: 4.034909391403199
95th percentile: 4.222276639938355
99th percentile: 4.37217043876648
mean time: 3.262708282470703
Pipeline stage StressChecker completed in 59.95s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
function_burul_2025-04-26 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3199.72s
Shutdown handler de-registered
function_burul_2025-04-26 status is now inactive due to auto deactivation removed underperforming models
function_burul_2025-04-26 status is now torndown due to DeploymentManager action