developer_uid: chai_backend_admin
submission_id: function_kilob_2025-07-02
model_name: function_kilob_2025-07-02
model_group:
status: torndown
timestamp: 2025-07-02T21:31:35+00:00
num_battles: 8043
num_wins: 4231
celo_rating: 1306.14
family_friendly_score: 0.5127999999999999
family_friendly_standard_error: 0.007068750384615374
submission_type: function
display_name: function_kilob_2025-07-02
is_internal_developer: True
ranking_group: single
us_pacific_date: 2025-07-02
win_ratio: 0.5260474947159021
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.338750600814819s
Received healthy response to inference request in 4.623875617980957s
Received healthy response to inference request in 3.1716830730438232s
Received healthy response to inference request in 2.931927442550659s
Received healthy response to inference request in 3.896310806274414s
5 requests
0 failed requests
5th percentile: 2.979878568649292
10th percentile: 3.0278296947479246
20th percentile: 3.1237319469451905
30th percentile: 3.3166086196899416
40th percentile: 3.606459712982178
50th percentile: 3.896310806274414
60th percentile: 4.187336730957031
70th percentile: 4.478362655639648
80th percentile: 4.76685061454773
90th percentile: 5.052800607681275
95th percentile: 5.1957756042480465
99th percentile: 5.310155601501465
mean time: 3.9925095081329345
%s, retrying in %s seconds...
Received healthy response to inference request in 5.32094144821167s
Received healthy response to inference request in 2.9639034271240234s
Received healthy response to inference request in 4.3554534912109375s
Received healthy response to inference request in 3.808448076248169s
Received healthy response to inference request in 3.41767954826355s
5 requests
0 failed requests
5th percentile: 3.0546586513519287
10th percentile: 3.145413875579834
20th percentile: 3.3269243240356445
30th percentile: 3.4958332538604737
40th percentile: 3.652140665054321
50th percentile: 3.808448076248169
60th percentile: 4.0272502422332765
70th percentile: 4.246052408218383
80th percentile: 4.548551082611084
90th percentile: 4.934746265411377
95th percentile: 5.127843856811523
99th percentile: 5.282321929931641
mean time: 3.97328519821167
%s, retrying in %s seconds...
Received healthy response to inference request in 3.6800787448883057s
Received healthy response to inference request in 3.013126850128174s
Received healthy response to inference request in 4.134239912033081s
Received healthy response to inference request in 3.385603189468384s
Received healthy response to inference request in 2.8870396614074707s
5 requests
0 failed requests
5th percentile: 2.9122570991516112
10th percentile: 2.9374745368957518
20th percentile: 2.9879094123840333
30th percentile: 3.087622117996216
40th percentile: 3.2366126537323
50th percentile: 3.385603189468384
60th percentile: 3.5033934116363525
70th percentile: 3.6211836338043213
80th percentile: 3.7709109783172607
90th percentile: 3.952575445175171
95th percentile: 4.043407678604126
99th percentile: 4.11607346534729
mean time: 3.420017671585083
Pipeline stage StressChecker completed in 61.21s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.99s
Shutdown handler de-registered
function_kilob_2025-07-02 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 3975.35s
Shutdown handler de-registered
function_kilob_2025-07-02 status is now inactive due to auto deactivation removed underperforming models
function_kilob_2025-07-02 status is now torndown due to DeploymentManager action