submission_id: function_nukal_2026-03-12
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-12T02:13:18+00:00
model_name: function_nukal_2026-03-12
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Received healthy response to inference request in 7.7927703857421875s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.6889994144439697s
Received healthy response to inference request in 4.04637598991394s
Received healthy response to inference request in 3.9897220134735107s
Received healthy response to inference request in 5.078758478164673s
Received healthy response to inference request in 2.6521544456481934s
Received healthy response to inference request in 4.380277872085571s
Received healthy response to inference request in 4.069941282272339s
Received healthy response to inference request in 4.982614755630493s
Received healthy response to inference request in 2.563610792160034s
Received healthy response to inference request in 6.253598213195801s
Received healthy response to inference request in 5.8479132652282715s
Received healthy response to inference request in 4.12729024887085s
Received healthy response to inference request in 4.348453998565674s
Received healthy response to inference request in 4.284321069717407s
Received healthy response to inference request in 3.605638265609741s
Received healthy response to inference request in 3.3914794921875s
10 requests
0 failed requests
5th percentile: 2.9848507165908815
10th percentile: 3.3175469875335692
20th percentile: 3.6294954299926756
30th percentile: 3.955658721923828
40th percentile: 4.104350662231445
50th percentile: 4.205805659294128
60th percentile: 4.462712144851684
70th percentile: 4.834836673736572
80th percentile: 5.313726425170898
90th percentile: 6.407515430450439
Received healthy response to inference request in 5.983677625656128s
95th percentile: 7.100142908096312
99th percentile: 7.654244890213013
mean time: 4.606961178779602
Pipeline stage StressChecker completed in 61.89s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
Received healthy response to inference request in 3.8717126846313477s
starting trigger_guanaco_pipeline args=%s
10 requests
triggered trigger_guanaco_pipeline args=%s
0 failed requests
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 4.54s
5th percentile: 3.0325231552124023
Shutdown handler de-registered
function_horeb_2026-03-12 status is now deployed due to DeploymentManager action
20th percentile: 3.8184978008270263
30th percentile: 3.954319214820862
function_horeb_2026-03-12 status is now inactive due to admin request
40th percentile: 4.023714399337768
50th percentile: 4.197414994239807
60th percentile: 4.361183547973633
70th percentile: 4.560978937149048
80th percentile: 5.155674457550049
90th percentile: 5.861489701271057
95th percentile: 5.922583663463592
99th percentile: 5.971458833217621
mean time: 4.361999726295471
Pipeline stage StressChecker completed in 60.42s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 2.50s
Shutdown handler de-registered
function_nukal_2026-03-12 status is now deployed due to DeploymentManager action
function_nukal_2026-03-12 status is now inactive due to admin request