Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage StressChecker
HTTPConnectionPool(host='guanaco-submitter.guanaco-backend.k2.chaiverse.com', port=80): Read timed out. (read timeout=20)
Received unhealthy response to inference request!
Received healthy response to inference request in 3.0608510971069336s
Received healthy response to inference request in 3.3673136234283447s
Received healthy response to inference request in 7.107690811157227s
Received healthy response to inference request in 4.165302276611328s
Received healthy response to inference request in 2.9053921699523926s
Received healthy response to inference request in 6.842344045639038s
Received healthy response to inference request in 3.159776210784912s
Received healthy response to inference request in 5.49445104598999s
Received healthy response to inference request in 3.7843306064605713s
10 requests
1 failed requests
5th percentile: 2.975348687171936
10th percentile: 3.0453052043914797
20th percentile: 3.1399911880493163
30th percentile: 3.305052399635315
40th percentile: 3.6175238132476806
50th percentile: 3.9748164415359497
60th percentile: 4.696961784362792
70th percentile: 5.898818945884704
80th percentile: 6.895413398742676
90th percentile: 8.42309348583221
95th percentile: 14.342405521869646
99th percentile: 19.077855150699616
mean time: 6.014916944503784
%s, retrying in %s seconds...
Received healthy response to inference request in 5.696073055267334s
Received healthy response to inference request in 4.95086145401001s
Received healthy response to inference request in 2.682331085205078s
Received healthy response to inference request in 4.962031602859497s
Received healthy response to inference request in 4.5323920249938965s
Received healthy response to inference request in 3.750683069229126s
Received healthy response to inference request in 4.216563701629639s
Received healthy response to inference request in 3.7411110401153564s
Received healthy response to inference request in 4.098947525024414s
Received healthy response to inference request in 2.1815168857574463s
10 requests
0 failed requests
5th percentile: 2.4068832755088807
10th percentile: 2.632249665260315
20th percentile: 3.529355049133301
30th percentile: 3.747811460494995
40th percentile: 3.9596417427062987
50th percentile: 4.157755613327026
60th percentile: 4.342895030975342
70th percentile: 4.65793285369873
80th percentile: 4.953095483779907
90th percentile: 5.03543574810028
95th percentile: 5.365754401683807
99th percentile: 5.630009324550628
mean time: 4.08125114440918
Pipeline stage StressChecker completed in 106.33s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyTriggerPipeline
run_pipeline:run_in_cloud %s
starting trigger_guanaco_pipeline args=%s
triggered trigger_guanaco_pipeline args=%s
Pipeline stage OfflineFamilyFriendlyTriggerPipeline completed in 0.72s
Shutdown handler de-registered
function_moguf_2025-12-29 status is now deployed due to DeploymentManager action
Shutdown handler registered
run pipeline %s
run pipeline stage %s
Running pipeline stage OfflineFamilyFriendlyScorer
Evaluating %s Family Friendly Score with %s threads
Generating Leaderboard row for %s
Generated Leaderboard row for %s
Pipeline stage OfflineFamilyFriendlyScorer completed in 2843.76s
Shutdown handler de-registered
function_moguf_2025-12-29 status is now torndown due to DeploymentManager action