developer_uid: NischayDnk
submission_id: function_fadis_2025-07-01
model_name: function_fadis_2025-07-01
model_group:
status: torndown
timestamp: 2025-07-01T01:18:33+00:00
num_battles: 8934
num_wins: 4578
celo_rating: 1299.28
family_friendly_score: 0.5754
family_friendly_standard_error: 0.0069902051472041935
submission_type: function
display_name: function_fadis_2025-07-01
is_internal_developer: False
ranking_group: single
us_pacific_date: 2025-06-30
win_ratio: 0.5124244459368704
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 4.6097657680511475s
Received healthy response to inference request in 2.6160640716552734s
Received healthy response to inference request in 1.144254207611084s
Received healthy response to inference request in 4.249704837799072s
5 requests
1 failed requests
5th percentile: 1.4386161804199218
10th percentile: 1.7329781532287598
20th percentile: 2.3217020988464356
30th percentile: 2.942792224884033
40th percentile: 3.596248531341553
50th percentile: 4.249704837799072
60th percentile: 4.393729209899902
70th percentile: 4.537753582000732
80th percentile: 7.729501152038576
90th percentile: 13.968971920013429
95th percentile: 17.088707304000852
99th percentile: 19.584495611190796
mean time: 6.565646314620972
%s, retrying in %s seconds...
Received healthy response to inference request in 9.574170589447021s
Received healthy response to inference request in 4.387946605682373s
Received healthy response to inference request in 4.2287983894348145s
Received healthy response to inference request in 1.14042329788208s
Received healthy response to inference request in 0.8954393863677979s
5 requests
0 failed requests
5th percentile: 0.9444361686706543
10th percentile: 0.9934329509735107
20th percentile: 1.0914265155792235
30th percentile: 1.7580983161926267
40th percentile: 2.9934483528137212
50th percentile: 4.2287983894348145
60th percentile: 4.2924576759338375
70th percentile: 4.3561169624328615
80th percentile: 5.425191402435304
90th percentile: 7.499680995941162
95th percentile: 8.536925792694092
99th percentile: 9.366721630096436
mean time: 4.045355653762817
%s, retrying in %s seconds...
Received healthy response to inference request in 3.1908977031707764s
Received healthy response to inference request in 4.806678533554077s
Received healthy response to inference request in 3.539329767227173s
Received healthy response to inference request in 1.0761799812316895s
Received healthy response to inference request in 0.7415540218353271s
5 requests
0 failed requests
5th percentile: 0.8084792137145996
10th percentile: 0.8754044055938721
20th percentile: 1.009254789352417
30th percentile: 1.4991235256195068
40th percentile: 2.3450106143951417
50th percentile: 3.1908977031707764
60th percentile: 3.330270528793335
70th percentile: 3.4696433544158936
80th percentile: 3.792799520492554
90th percentile: 4.299739027023316
95th percentile: 4.5532087802886965
99th percentile: 4.755984582901001
mean time: 2.6709280014038086
Pipeline stage StressChecker completed in 80.14s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.77s
Shutdown handler de-registered
function_fadis_2025-07-01 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3577.00s
Shutdown handler de-registered
function_fadis_2025-07-01 status is now inactive due to auto deactivation removed underperforming models
function_fadis_2025-07-01 status is now torndown due to DeploymentManager action