submission_id: function_nusof_2025-04-19
developer_uid: azuruce
status: failed
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 100, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['You:', 'Me:', 'User:'], 'max_input_tokens': 1024, 'best_of': 1, 'max_output_tokens': 96}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-04-19T19:02:10+00:00
model_name: grok3
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.8753838539123535s
Received healthy response to inference request in 3.8109235763549805s
Received healthy response to inference request in 2.9751322269439697s
Received healthy response to inference request in 4.457780122756958s
Received healthy response to inference request in 4.059048652648926s
5 requests
0 failed requests
5th percentile: 3.142290496826172
10th percentile: 3.309448766708374
20th percentile: 3.6437653064727784
30th percentile: 3.823815631866455
40th percentile: 3.849599742889404
50th percentile: 3.8753838539123535
60th percentile: 3.9488497734069825
70th percentile: 4.0223156929016115
80th percentile: 4.138794946670532
90th percentile: 4.2982875347137455
95th percentile: 4.378033828735352
99th percentile: 4.441830863952637
mean time: 3.8356536865234374
%s, retrying in %s seconds...
Received healthy response to inference request in 4.105401992797852s
Received healthy response to inference request in 3.412910223007202s
Received healthy response to inference request in 4.051608562469482s
Received healthy response to inference request in 3.763439178466797s
Received healthy response to inference request in 2.978031873703003s
5 requests
0 failed requests
5th percentile: 3.065007543563843
10th percentile: 3.151983213424683
20th percentile: 3.325934553146362
30th percentile: 3.483016014099121
40th percentile: 3.623227596282959
50th percentile: 3.763439178466797
60th percentile: 3.878706932067871
70th percentile: 3.9939746856689453
80th percentile: 4.062367248535156
90th percentile: 4.083884620666504
95th percentile: 4.094643306732178
99th percentile: 4.103250255584717
mean time: 3.6622783660888674
%s, retrying in %s seconds...
Received healthy response to inference request in 3.8294711112976074s
Received healthy response to inference request in 3.800522804260254s
Received healthy response to inference request in 4.342217445373535s
Received healthy response to inference request in 3.4289391040802s
Received healthy response to inference request in 3.3929429054260254s
5 requests
0 failed requests
5th percentile: 3.4001421451568605
10th percentile: 3.4073413848876952
20th percentile: 3.421739864349365
30th percentile: 3.503255844116211
40th percentile: 3.6518893241882324
50th percentile: 3.800522804260254
60th percentile: 3.812102127075195
70th percentile: 3.823681449890137
80th percentile: 3.932020378112793
90th percentile: 4.137118911743164
95th percentile: 4.239668178558349
99th percentile: 4.321707592010498
mean time: 3.7588186740875242
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 3.823681449890137s')
Shutdown handler de-registered
function_nusof_2025-04-19 status is now failed due to DeploymentManager action