submission_id: function_furef_2026-03-09
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-09T20:02:52+00:00
model_name: function_furef_2026-03-09
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.315294981002808s
Received healthy response to inference request in 3.603850841522217s
Received healthy response to inference request in 4.523690462112427s
Received healthy response to inference request in 5.407663822174072s
Received healthy response to inference request in 3.9458885192871094s
Received healthy response to inference request in 4.9619364738464355s
Received healthy response to inference request in 4.394237041473389s
Received healthy response to inference request in 4.422431707382202s
Received healthy response to inference request in 5.206584692001343s
Received healthy response to inference request in 5.580294370651245s
10 requests
0 failed requests
5th percentile: 3.7577677965164185
10th percentile: 3.91168475151062
20th percentile: 4.241413688659668
30th percentile: 4.370554423332214
40th percentile: 4.411153841018677
50th percentile: 4.4730610847473145
60th percentile: 4.6989888668060305
70th percentile: 5.0353309392929075
80th percentile: 5.246800518035888
90th percentile: 5.4249268770217896
95th percentile: 5.502610623836517
99th percentile: 5.564757621288299
mean time: 4.636187291145324
Pipeline stage StressChecker completed in 78.32s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 5.45s
Shutdown handler de-registered
function_furef_2026-03-09 status is now deployed due to DeploymentManager action
function_furef_2026-03-09 status is now inactive due to admin request