submission_id: function_lemib_2025-07-14
developer_uid: chai_backend_admin
status: failed
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-14T18:21:56+00:00
model_name: function_lemib_2025-07-14
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.800706148147583s
Received healthy response to inference request in 4.391219615936279s
Received healthy response to inference request in 2.6957406997680664s
Received healthy response to inference request in 4.729466199874878s
Received healthy response to inference request in 4.792597770690918s
5 requests
0 failed requests
5th percentile: 2.9167337894439695
10th percentile: 3.137726879119873
20th percentile: 3.57971305847168
30th percentile: 3.918808841705322
40th percentile: 4.155014228820801
50th percentile: 4.391219615936279
60th percentile: 4.526518249511719
70th percentile: 4.661816883087158
80th percentile: 4.742092514038086
90th percentile: 4.767345142364502
95th percentile: 4.77997145652771
99th percentile: 4.790072507858277
mean time: 4.081946086883545
%s, retrying in %s seconds...
Received healthy response to inference request in 3.8545174598693848s
Received healthy response to inference request in 3.6461780071258545s
Received healthy response to inference request in 5.558574914932251s
Received healthy response to inference request in 4.950495719909668s
Received healthy response to inference request in 2.8647563457489014s
5 requests
0 failed requests
5th percentile: 3.021040678024292
10th percentile: 3.1773250102996826
20th percentile: 3.489893674850464
30th percentile: 3.6878458976745607
40th percentile: 3.7711816787719727
50th percentile: 3.8545174598693848
60th percentile: 4.292908763885498
70th percentile: 4.7313000679016115
80th percentile: 5.072111558914185
90th percentile: 5.315343236923217
95th percentile: 5.436959075927734
99th percentile: 5.534251747131347
mean time: 4.174904489517212
%s, retrying in %s seconds...
Received healthy response to inference request in 3.196859121322632s
Received healthy response to inference request in 5.829869508743286s
Received healthy response to inference request in 3.093945026397705s
Received healthy response to inference request in 3.3496170043945312s
Received healthy response to inference request in 4.833201885223389s
5 requests
0 failed requests
5th percentile: 3.1145278453826903
10th percentile: 3.1351106643676756
20th percentile: 3.1762763023376466
30th percentile: 3.2274106979370116
40th percentile: 3.2885138511657717
50th percentile: 3.3496170043945312
60th percentile: 3.943050956726074
70th percentile: 4.5364849090576165
80th percentile: 5.032535409927369
90th percentile: 5.431202459335327
95th percentile: 5.630535984039306
99th percentile: 5.79000280380249
mean time: 4.060698509216309
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 4.5364849090576165s')
Shutdown handler de-registered
function_lemib_2025-07-14 status is now failed due to DeploymentManager action