submission_id: function_kakir_2025-01-08
developer_uid: jxlu90
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-01-08T22:50:10+00:00
model_name: characterai
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.59800910949707s
Received healthy response to inference request in 5.9331443309783936s
Received healthy response to inference request in 4.006187915802002s
Received healthy response to inference request in 4.49629807472229s
Received healthy response to inference request in 7.798429489135742s
5 requests
0 failed requests
5th percentile: 4.104209947586059
10th percentile: 4.202231979370117
20th percentile: 4.398276042938233
30th percentile: 4.516640281677246
40th percentile: 4.557324695587158
50th percentile: 4.59800910949707
60th percentile: 5.132063198089599
70th percentile: 5.6661172866821286
80th percentile: 6.306201362609864
90th percentile: 7.052315425872803
95th percentile: 7.425372457504272
99th percentile: 7.723818082809448
mean time: 5.3664137840271
%s, retrying in %s seconds...
Received healthy response to inference request in 6.4982380867004395s
Received healthy response to inference request in 3.388775587081909s
Received healthy response to inference request in 3.114511251449585s
Received healthy response to inference request in 3.6421711444854736s
Received healthy response to inference request in 5.866011619567871s
5 requests
0 failed requests
5th percentile: 3.1693641185760497
10th percentile: 3.2242169857025145
20th percentile: 3.3339227199554444
30th percentile: 3.439454698562622
40th percentile: 3.540812921524048
50th percentile: 3.6421711444854736
60th percentile: 4.531707334518432
70th percentile: 5.421243524551391
80th percentile: 5.992456912994385
90th percentile: 6.245347499847412
95th percentile: 6.371792793273926
99th percentile: 6.472949028015137
mean time: 4.501941537857055
%s, retrying in %s seconds...
Received healthy response to inference request in 4.902047157287598s
Received healthy response to inference request in 3.428391218185425s
Received healthy response to inference request in 3.4210801124572754s
Received healthy response to inference request in 5.812923908233643s
Received healthy response to inference request in 4.2576518058776855s
5 requests
0 failed requests
5th percentile: 3.4225423336029053
10th percentile: 3.424004554748535
20th percentile: 3.426928997039795
30th percentile: 3.5942433357238768
40th percentile: 3.925947570800781
50th percentile: 4.2576518058776855
60th percentile: 4.51540994644165
70th percentile: 4.773168087005615
80th percentile: 5.084222507476807
90th percentile: 5.448573207855224
95th percentile: 5.630748558044433
99th percentile: 5.7764888381958
mean time: 4.364418840408325
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 4.773168087005615s')
Shutdown handler de-registered
function_kakir_2025-01-08 status is now failed due to DeploymentManager action
function_kakir_2025-01-08 status is now torndown due to DeploymentManager action