submission_id: function_patot_2025-06-07
developer_uid: rirv938
status: failed
generation_params: {'temperature': 0.9, 'top_p': 0.9, 'min_p': 0.05, 'top_k': 80, 'presence_penalty': 0.5, 'frequency_penalty': 0.5, 'stopping_words': ['\n', '</s>'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': "{bot_name}'s Persona: {memory}\n####\n", 'prompt_template': '{prompt}\n<START>\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-06-07T18:12:06+00:00
model_name: dpo_data_collection
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.252897024154663s
Received healthy response to inference request in 5.893450021743774s
Received healthy response to inference request in 3.379647731781006s
Received healthy response to inference request in 3.911965847015381s
Received healthy response to inference request in 3.6799850463867188s
5 requests
0 failed requests
5th percentile: 3.4397151947021483
10th percentile: 3.499782657623291
20th percentile: 3.6199175834655763
30th percentile: 3.726381206512451
40th percentile: 3.819173526763916
50th percentile: 3.911965847015381
60th percentile: 4.048338317871094
70th percentile: 4.1847107887268065
80th percentile: 4.581007623672486
90th percentile: 5.23722882270813
95th percentile: 5.565339422225952
99th percentile: 5.82782790184021
mean time: 4.223589134216309
%s, retrying in %s seconds...
Received healthy response to inference request in 3.954845428466797s
Received healthy response to inference request in 3.8471994400024414s
Received healthy response to inference request in 4.656381845474243s
Received healthy response to inference request in 3.0780608654022217s
Received healthy response to inference request in 4.761521816253662s
5 requests
0 failed requests
5th percentile: 3.2318885803222654
10th percentile: 3.3857162952423097
20th percentile: 3.6933717250823976
30th percentile: 3.8687286376953125
40th percentile: 3.9117870330810547
50th percentile: 3.954845428466797
60th percentile: 4.235459995269776
70th percentile: 4.516074562072753
80th percentile: 4.677409839630127
90th percentile: 4.719465827941894
95th percentile: 4.740493822097778
99th percentile: 4.757316217422486
mean time: 4.059601879119873
%s, retrying in %s seconds...
Received healthy response to inference request in 6.076882839202881s
Received healthy response to inference request in 3.9197757244110107s
Received healthy response to inference request in 5.86281681060791s
Received healthy response to inference request in 4.118797063827515s
Received healthy response to inference request in 6.2133684158325195s
5 requests
0 failed requests
5th percentile: 3.9595799922943113
10th percentile: 3.9993842601776124
20th percentile: 4.078992795944214
30th percentile: 4.467601013183594
40th percentile: 5.1652089118957525
50th percentile: 5.86281681060791
60th percentile: 5.948443222045898
70th percentile: 6.034069633483886
80th percentile: 6.104179954528808
90th percentile: 6.158774185180664
95th percentile: 6.186071300506592
99th percentile: 6.207908992767334
mean time: 5.238328170776367
clean up pipeline due to error=DeploymentChecksError('Unacceptable 70th percentile latency 6.034069633483886s')
Shutdown handler de-registered
function_patot_2025-06-07 status is now failed due to DeploymentManager action