developer_uid: chai_backend_admin
submission_id: function_dorur_2025-04-19
model_name: function_dorur_2025-04-19
model_group:
status: torndown
timestamp: 2025-04-19T09:50:05+00:00
num_battles: 7136
num_wins: 3578
celo_rating: 1289.6
family_friendly_score: 0.5252
family_friendly_standard_error: 0.007062081279622884
submission_type: function
display_name: function_dorur_2025-04-19
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-04-19
win_ratio: 0.5014013452914798
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.454336404800415s
Received healthy response to inference request in 3.77608585357666s
Received healthy response to inference request in 3.593825101852417s
Received healthy response to inference request in 2.9948971271514893s
Received healthy response to inference request in 3.7522547245025635s
5 requests
0 failed requests
5th percentile: 3.0867849826812743
10th percentile: 3.1786728382110594
20th percentile: 3.36244854927063
30th percentile: 3.4822341442108153
40th percentile: 3.5380296230316164
50th percentile: 3.593825101852417
60th percentile: 3.6571969509124758
70th percentile: 3.720568799972534
80th percentile: 3.757020950317383
90th percentile: 3.7665534019470215
95th percentile: 3.771319627761841
99th percentile: 3.7751326084136965
mean time: 3.514279842376709
%s, retrying in %s seconds...
Received healthy response to inference request in 3.7747528553009033s
Received healthy response to inference request in 4.370495319366455s
Received healthy response to inference request in 4.989043712615967s
Received healthy response to inference request in 3.87345027923584s
Received healthy response to inference request in 4.315048694610596s
5 requests
0 failed requests
5th percentile: 3.7944923400878907
10th percentile: 3.814231824874878
20th percentile: 3.8537107944488525
30th percentile: 3.961769962310791
40th percentile: 4.1384093284606935
50th percentile: 4.315048694610596
60th percentile: 4.3372273445129395
70th percentile: 4.359405994415283
80th percentile: 4.494204998016357
90th percentile: 4.741624355316162
95th percentile: 4.8653340339660645
99th percentile: 4.9643017768859865
mean time: 4.264558172225952
%s, retrying in %s seconds...
Received healthy response to inference request in 3.0545654296875s
Received healthy response to inference request in 2.740250825881958s
Received healthy response to inference request in 4.007617950439453s
Received healthy response to inference request in 3.737590789794922s
Received healthy response to inference request in 2.924241542816162s
5 requests
0 failed requests
5th percentile: 2.7770489692687987
10th percentile: 2.8138471126556395
20th percentile: 2.8874433994293214
30th percentile: 2.9503063201904296
40th percentile: 3.002435874938965
50th percentile: 3.0545654296875
60th percentile: 3.327775573730469
70th percentile: 3.6009857177734372
80th percentile: 3.7915962219238284
90th percentile: 3.8996070861816405
95th percentile: 3.9536125183105466
99th percentile: 3.996816864013672
mean time: 3.292853307723999
Pipeline stage StressChecker completed in 58.96s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.79s
Shutdown handler de-registered
function_dorur_2025-04-19 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3385.46s
Shutdown handler de-registered
function_dorur_2025-04-19 status is now inactive due to auto deactivation removed underperforming models
function_dorur_2025-04-19 status is now torndown due to DeploymentManager action