submission_id: function_legok_2026-02-17
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': 'CUSTOM', 'prompt_template': 'CUSTOM', 'bot_template': 'CUSTOM', 'user_template': 'CUSTOM', 'response_template': 'CUSTOM', 'truncate_by_message': False}
timestamp: 2026-02-17T20:40:51+00:00
model_name: function_legok_2026-02-17
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 5.818646669387817s
Received healthy response to inference request in 4.72153115272522s
Received healthy response to inference request in 4.9642014503479s
Received healthy response to inference request in 5.869658708572388s
Received healthy response to inference request in 5.200384855270386s
Received healthy response to inference request in 4.83316707611084s
Received healthy response to inference request in 4.270057201385498s
Received healthy response to inference request in 4.590667009353638s
Received healthy response to inference request in 5.441570281982422s
Received healthy response to inference request in 3.898247241973877s
10 requests
0 failed requests
5th percentile: 4.065561723709107
10th percentile: 4.232876205444336
20th percentile: 4.52654504776001
30th percentile: 4.682271909713745
40th percentile: 4.788512706756592
50th percentile: 4.89868426322937
60th percentile: 5.0586748123168945
70th percentile: 5.272740483283997
80th percentile: 5.516985559463501
90th percentile: 5.823747873306274
95th percentile: 5.846703290939331
99th percentile: 5.865067625045777
mean time: 4.9608131647109985
Pipeline stage StressChecker completed in 51.65s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.91s
Shutdown handler de-registered
function_legok_2026-02-17 status is now deployed due to DeploymentManager action
function_legok_2026-02-17 status is now inactive due to admin request