submission_id: function_rokel_2026-03-23
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-23T18:05:22+00:00
model_name: function_rokel_2026-03-23
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.24685525894165s
Received healthy response to inference request in 8.756653785705566s
Received healthy response to inference request in 5.305747747421265s
Received healthy response to inference request in 5.599740505218506s
Received healthy response to inference request in 5.821720123291016s
Received healthy response to inference request in 3.2952253818511963s
Received healthy response to inference request in 4.00104022026062s
Received healthy response to inference request in 4.364936351776123s
Received healthy response to inference request in 3.0010616779327393s
Received healthy response to inference request in 5.952487468719482s
10 requests
0 failed requests
5th percentile: 3.133435344696045
10th percentile: 3.2658090114593508
20th percentile: 3.8598772525787353
30th percentile: 4.255767512321472
40th percentile: 4.89408769607544
50th percentile: 5.2763015031814575
60th percentile: 5.423344850540161
70th percentile: 5.666334390640259
80th percentile: 5.847873592376709
90th percentile: 6.232904100418089
95th percentile: 7.494778943061826
99th percentile: 8.50427881717682
mean time: 5.134546852111816
Pipeline stage StressChecker completed in 55.90s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.59s
Shutdown handler de-registered
function_rokel_2026-03-23 status is now deployed due to DeploymentManager action
function_rokel_2026-03-23 status is now inactive due to admin request