developer_uid: chai_backend_admin
submission_id: function_sebin_2025-07-09
model_name: function_sebin_2025-07-09
model_group:
status: torndown
timestamp: 2025-07-09T23:41:01+00:00
num_battles: 6937
num_wins: 3496
celo_rating: 1289.37
family_friendly_score: 0.5334
family_friendly_standard_error: 0.007055273772150873
submission_type: function
display_name: function_sebin_2025-07-09
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-07-09
win_ratio: 0.5039642496756523
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.376526117324829s
Received healthy response to inference request in 4.789545059204102s
Received healthy response to inference request in 2.3128502368927s
Received healthy response to inference request in 3.286404848098755s
Received healthy response to inference request in 2.818687915802002s
5 requests
0 failed requests
5th percentile: 2.4140177726745606
10th percentile: 2.515185308456421
20th percentile: 2.7175203800201415
30th percentile: 2.9122313022613526
40th percentile: 3.0993180751800535
50th percentile: 3.286404848098755
60th percentile: 3.7224533557891846
70th percentile: 4.158501863479614
80th percentile: 4.459129905700683
90th percentile: 4.624337482452392
95th percentile: 4.706941270828247
99th percentile: 4.773024301528931
mean time: 3.5168028354644774
%s, retrying in %s seconds...
Received healthy response to inference request in 4.2464587688446045s
Received healthy response to inference request in 4.0228111743927s
Received healthy response to inference request in 4.8632707595825195s
Received healthy response to inference request in 2.5982348918914795s
Received healthy response to inference request in 2.930027484893799s
5 requests
0 failed requests
5th percentile: 2.6645934104919435
10th percentile: 2.730951929092407
20th percentile: 2.863668966293335
30th percentile: 3.148584222793579
40th percentile: 3.58569769859314
50th percentile: 4.0228111743927
60th percentile: 4.112270212173462
70th percentile: 4.201729249954224
80th percentile: 4.369821166992188
90th percentile: 4.616545963287353
95th percentile: 4.739908361434936
99th percentile: 4.838598279953003
mean time: 3.7321606159210203
%s, retrying in %s seconds...
Received healthy response to inference request in 3.2661960124969482s
Received healthy response to inference request in 3.356853485107422s
Received healthy response to inference request in 2.1475772857666016s
Received healthy response to inference request in 3.8100647926330566s
Received healthy response to inference request in 3.136183977127075s
5 requests
0 failed requests
5th percentile: 2.3452986240386964
10th percentile: 2.543019962310791
20th percentile: 2.9384626388549804
30th percentile: 3.16218638420105
40th percentile: 3.214191198348999
50th percentile: 3.2661960124969482
60th percentile: 3.3024590015411377
70th percentile: 3.338721990585327
80th percentile: 3.447495746612549
90th percentile: 3.6287802696228026
95th percentile: 3.7194225311279294
99th percentile: 3.791936340332031
mean time: 3.143375110626221
Pipeline stage StressChecker completed in 56.03s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 1.04s
Shutdown handler de-registered
function_sebin_2025-07-09 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3561.66s
Shutdown handler de-registered
function_sebin_2025-07-09 status is now inactive due to auto deactivation removed underperforming models
function_sebin_2025-07-09 status is now torndown due to DeploymentManager action