submission_id: function_tedob_2026-03-18
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-18T11:46:20+00:00
model_name: function_tedob_2026-03-18
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.007359504699707s
Received healthy response to inference request in 2.9681649208068848s
Received healthy response to inference request in 3.993741989135742s
Received healthy response to inference request in 3.524540424346924s
Received healthy response to inference request in 3.4357359409332275s
Received healthy response to inference request in 2.9913105964660645s
Received healthy response to inference request in 3.549076557159424s
Received healthy response to inference request in 3.1512386798858643s
Received healthy response to inference request in 4.580005407333374s
Received healthy response to inference request in 3.4629087448120117s
10 requests
0 failed requests
5th percentile: 2.9785804748535156
10th percentile: 2.9889960289001465
20th percentile: 3.0041497230529783
30th percentile: 3.108074927330017
40th percentile: 3.3219370365142824
50th percentile: 3.4493223428726196
60th percentile: 3.4875614166259767
70th percentile: 3.5319012641906737
80th percentile: 3.6380096435546876
90th percentile: 4.052368330955505
95th percentile: 4.316186869144439
99th percentile: 4.527241699695587
mean time: 3.4664082765579223
Pipeline stage StressChecker completed in 45.35s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.70s
Shutdown handler de-registered
function_tedob_2026-03-18 status is now deployed due to DeploymentManager action
function_tedob_2026-03-18 status is now inactive due to admin request