submission_id: function_hoguf_2025-01-08
developer_uid: jxlu90
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-12-20T00:28:50+00:00
model_name: characterai
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 3.49951171875s
Received healthy response to inference request in 4.495416164398193s
Received healthy response to inference request in 5.3370771408081055s
Received healthy response to inference request in 4.2450642585754395s
Received healthy response to inference request in 2.858738660812378s
5 requests
0 failed requests
5th percentile: 2.9868932723999024
10th percentile: 3.115047883987427
20th percentile: 3.3713571071624755
30th percentile: 3.648622226715088
40th percentile: 3.9468432426452638
50th percentile: 4.2450642585754395
60th percentile: 4.345205020904541
70th percentile: 4.445345783233643
80th percentile: 4.663748359680176
90th percentile: 5.0004127502441404
95th percentile: 5.1687449455261225
99th percentile: 5.303410701751709
mean time: 4.087161588668823
%s, retrying in %s seconds...
Received healthy response to inference request in 4.042185544967651s
Received healthy response to inference request in 4.574312448501587s
Received healthy response to inference request in 3.9425582885742188s
Received healthy response to inference request in 3.925971508026123s
Received healthy response to inference request in 8.026639461517334s
5 requests
0 failed requests
5th percentile: 3.929288864135742
10th percentile: 3.9326062202453613
20th percentile: 3.9392409324645996
30th percentile: 3.9624837398529054
40th percentile: 4.002334642410278
50th percentile: 4.042185544967651
60th percentile: 4.255036306381226
70th percentile: 4.4678870677948
80th percentile: 5.264777851104737
90th percentile: 6.645708656311036
95th percentile: 7.3361740589141835
99th percentile: 7.888546380996704
mean time: 4.902333450317383
%s, retrying in %s seconds...
Received healthy response to inference request in 4.991429090499878s
Received healthy response to inference request in 2.95454478263855s
Received healthy response to inference request in 6.031429052352905s
Received healthy response to inference request in 3.543442964553833s
Received healthy response to inference request in 3.563325881958008s
5 requests
0 failed requests
5th percentile: 3.0723244190216064
10th percentile: 3.190104055404663
20th percentile: 3.4256633281707765
30th percentile: 3.547419548034668
40th percentile: 3.555372714996338
50th percentile: 3.563325881958008
60th percentile: 4.134567165374756
70th percentile: 4.705808448791504
80th percentile: 5.199429082870483
90th percentile: 5.615429067611695
95th percentile: 5.8234290599823
99th percentile: 5.989829053878784
mean time: 4.216834354400635
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 4.705808448791504s')
Shutdown handler de-registered
function_hoguf_2025-01-08 status is now failed due to DeploymentManager action
function_hoguf_2025-01-08 status is now torndown due to DeploymentManager action