submission_id: function_gutol_2026-03-12
developer_uid: chai_backend_admin
status: inactive
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2026-03-12T04:42:02+00:00
model_name: function_gutol_2026-03-12
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
Received healthy response to inference request in 3.155719518661499s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8495466709136963s
Received healthy response to inference request in 3.1664469242095947s
Received healthy response to inference request in 2.940180540084839s
Received healthy response to inference request in 3.6792843341827393s
Received healthy response to inference request in 3.4766674041748047s
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received healthy response to inference request in 3.0143485069274902s
Received unhealthy response to inference request!
Received healthy response to inference request in 3.5331854820251465s
Received healthy response to inference request in 3.613494396209717s
Received healthy response to inference request in 2.846461772918701s
Received healthy response to inference request in 3.5298216342926025s
10 requests
1 failed requests
Received healthy response to inference request in 3.084199905395508s
5th percentile: 3.210180914402008
10th percentile: 3.2646423101425173
20th percentile: 3.3393054962158204
Received healthy response to inference request in 4.3213889598846436s
30th percentile: 3.36579270362854
40th percentile: 3.466069555282593
50th percentile: 3.5315035581588745
Received healthy response to inference request in 2.936471939086914s
60th percentile: 3.586604690551758
10 requests
70th percentile: 3.721577453613281
0 failed requests
80th percentile: 3.8633981227874754
5th percentile: 2.886966347694397
90th percentile: 5.918792605400078
10th percentile: 2.9274709224700928
95th percentile: 14.918741643428781
20th percentile: 2.939438819885254
99th percentile: 22.11870087385178
30th percentile: 2.9920981168746947
mean time: 5.557463335990906
40th percentile: 3.056259346008301
%s, retrying in %s seconds...
50th percentile: 3.1253234148025513
60th percentile: 3.2905351161956786
70th percentile: 3.517715501785278
Received healthy response to inference request in 4.059477090835571s
80th percentile: 3.626652383804321
90th percentile: 3.7434947967529295
95th percentile: 4.032441878318786
Received healthy response to inference request in 3.746950387954712s
99th percentile: 4.263599543571472
mean time: 3.307894468307495
Received healthy response to inference request in 4.17926025390625s
Pipeline stage StressChecker completed in 93.82s
run pipeline stage %s
Received healthy response to inference request in 2.8371901512145996s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
Received healthy response to inference request in 3.1517038345336914s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 9.23s
Received healthy response to inference request in 3.111713171005249s
Shutdown handler de-registered
function_gutol_2026-03-12 status is now deployed due to DeploymentManager action
function_gutol_2026-03-12 status is now inactive due to admin request