submission_id: function_hirel_2025-07-14
developer_uid: chai_backend_admin
status: torndown
generation_params: {'temperature': 1.0, 'top_p': 1.0, 'min_p': 0.0, 'top_k': 40, 'presence_penalty': 0.0, 'frequency_penalty': 0.0, 'stopping_words': ['\n'], 'max_input_tokens': 1024, 'best_of': 8, 'max_output_tokens': 64}
formatter: {'memory_template': '### Instruction:\n{memory}\n', 'prompt_template': '### Input:\n{prompt}\n', 'bot_template': '{bot_name}: {message}\n', 'user_template': '{user_name}: {message}\n', 'response_template': '### Response:\n{bot_name}:', 'truncate_by_message': False}
timestamp: 2025-07-14T18:59:28+00:00
model_name: function_hirel_2025-07-14
Resubmit model
Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
Received healthy response to inference request in 4.385287046432495s
Received healthy response to inference request in 3.832740306854248s
Received healthy response to inference request in 4.949465036392212s
Received healthy response to inference request in 3.147122859954834s
Received healthy response to inference request in 2.7496678829193115s
5 requests
0 failed requests
5th percentile: 2.829158878326416
10th percentile: 2.9086498737335207
20th percentile: 3.0676318645477294
30th percentile: 3.2842463493347167
40th percentile: 3.5584933280944826
50th percentile: 3.832740306854248
60th percentile: 4.053759002685547
70th percentile: 4.2747776985168455
80th percentile: 4.498122644424439
90th percentile: 4.723793840408325
95th percentile: 4.836629438400268
99th percentile: 4.926897916793823
mean time: 3.8128566265106203
%s, retrying in %s seconds...
Received healthy response to inference request in 3.1492815017700195s
Received healthy response to inference request in 3.507908582687378s
Received healthy response to inference request in 4.626055717468262s
Received healthy response to inference request in 3.7747702598571777s
Received healthy response to inference request in 3.300797939300537s
5 requests
0 failed requests
5th percentile: 3.179584789276123
10th percentile: 3.2098880767822267
20th percentile: 3.2704946517944338
30th percentile: 3.3422200679779053
40th percentile: 3.4250643253326416
50th percentile: 3.507908582687378
60th percentile: 3.6146532535552978
70th percentile: 3.7213979244232176
80th percentile: 3.9450273513793945
90th percentile: 4.285541534423828
95th percentile: 4.455798625946045
99th percentile: 4.592004299163818
mean time: 3.671762800216675
%s, retrying in %s seconds...
Received healthy response to inference request in 3.843480110168457s
Received healthy response to inference request in 2.6884753704071045s
Received healthy response to inference request in 2.9356887340545654s
Received healthy response to inference request in 2.356410264968872s
Received healthy response to inference request in 4.13346529006958s
5 requests
0 failed requests
5th percentile: 2.4228232860565186
10th percentile: 2.489236307144165
20th percentile: 2.622062349319458
30th percentile: 2.7379180431365966
40th percentile: 2.8368033885955812
50th percentile: 2.9356887340545654
60th percentile: 3.298805284500122
70th percentile: 3.6619218349456784
80th percentile: 3.901477146148682
90th percentile: 4.017471218109131
95th percentile: 4.075468254089356
99th percentile: 4.121865882873535
mean time: 3.191503953933716
Pipeline stage StressChecker completed in 57.54s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.75s
Shutdown handler de-registered
function_hirel_2025-07-14 status is now deployed due to DeploymentManager action
function_hirel_2025-07-14 status is now inactive due to admin request
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Pipeline stage OfflineFamilyFriendlyScorer completed in 5920.28s
Shutdown handler de-registered
function_hirel_2025-07-14 status is now torndown due to DeploymentManager action