submission_id: function_nabuk_2025-07-10
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-10T02:45:32+00:00
model_name: function_nabuk_2025-07-10
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.214426040649414s
Received healthy response to inference request in 2.8400027751922607s
Received healthy response to inference request in 3.079646110534668s
Received healthy response to inference request in 4.261729001998901s
Received healthy response to inference request in 4.7720277309417725s
5 requests
0 failed requests
5th percentile: 2.8879314422607423
10th percentile: 2.935860109329224
20th percentile: 3.0317174434661864
30th percentile: 3.106602096557617
40th percentile: 3.160514068603516
50th percentile: 3.214426040649414
60th percentile: 3.6333472251892087
70th percentile: 4.052268409729003
80th percentile: 4.363788747787476
90th percentile: 4.567908239364624
95th percentile: 4.669967985153198
99th percentile: 4.751615781784057
mean time: 3.6335663318634035
%s, retrying in %s seconds...
Received healthy response to inference request in 3.5516529083251953s
Received healthy response to inference request in 2.2739813327789307s
Received healthy response to inference request in 3.3531334400177s
Received healthy response to inference request in 3.9860522747039795s
Received healthy response to inference request in 3.3498401641845703s
5 requests
0 failed requests
5th percentile: 2.4891530990600588
10th percentile: 2.7043248653411864
20th percentile: 3.134668397903442
30th percentile: 3.350498819351196
40th percentile: 3.3518161296844484
50th percentile: 3.3531334400177
60th percentile: 3.4325412273406983
70th percentile: 3.5119490146636965
80th percentile: 3.638532781600952
90th percentile: 3.812292528152466
95th percentile: 3.8991724014282227
99th percentile: 3.9686763000488283
mean time: 3.302932024002075
Pipeline stage StressChecker completed in 37.16s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.76s
Shutdown handler de-registered
function_nabuk_2025-07-10 status is now deployed due to DeploymentManager action
function_nabuk_2025-07-10 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 4002.77s
Shutdown handler de-registered
function_nabuk_2025-07-10 status is now torndown due to DeploymentManager action