Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gspo-glm47-cas72-96754-v1-uploader
Waiting for job on chaiml-gspo-glm47-cas72-96754-v1-uploader to finish
chaiml-gspo-glm47-cas72-96754-v1-uploader: Using quantization_mode: fp8
chaiml-gspo-glm47-cas72-96754-v1-uploader: Checking if ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step300-FP8 already exists in ChaiML
chaiml-gspo-glm47-cas72-96754-v1-uploader: Downloading snapshot of ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step300...
2026-03-23T20:42:08.776276+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:43:08.866972+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:44:08.945774+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:45:09.021993+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:46:09.105916+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
chaiml-gspo-glm47-cas72-96754-v1-uploader: Downloaded in 261.695s
chaiml-gspo-glm47-cas72-96754-v1-uploader: Loading /tmp/model_input...
chaiml-gspo-glm47-cas72-96754-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-cas72-96754-v1-uploader: `torch_dtype` is deprecated! Use `dtype` instead!
2026-03-23T20:47:09.186720+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
chaiml-gspo-glm47-cas72-96754-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-gspo-glm47-cas72-96754-v1-uploader: Applying quantization...
chaiml-gspo-glm47-cas72-96754-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-cas72-96754-v1-uploader: 2026-03-23T13:47:16.113353-0700 | reset | INFO - Compression lifecycle reset
chaiml-gspo-glm47-cas72-96754-v1-uploader: 2026-03-23T13:47:16.179691-0700 | from_modifiers | INFO - Creating recipe from modifiers
2026-03-23T20:48:09.270762+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
chaiml-gspo-glm47-cas72-96754-v1-uploader: 2026-03-23T13:48:12.937057-0700 | initialize | INFO - Compression lifecycle initialized for 1 modifiers
chaiml-gspo-glm47-cas72-96754-v1-uploader: 2026-03-23T13:48:12.937564-0700 | IndependentPipeline | INFO - Inferred `DataFreePipeline` for `QuantizationModifier`
chaiml-gspo-glm47-cas72-96754-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
2026-03-23T20:49:09.352205+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:50:09.435477+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:51:09.531146+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:52:09.618958+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:53:09.702283+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:54:09.787521+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:55:09.881127+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:56:09.970391+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:57:10.067291+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:58:10.159197+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T20:59:10.261911+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
2026-03-23T21:00:10.362182+00:00 monitor updated for chaiml-gspo-glm47-cas72_96754_v1
chaiml-gspo-glm47-cas72_96754_v1 status is now deployed due to DeploymentManager action
chaiml-gspo-glm47-cas72_96754_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-gspo-glm47-cas72_96754_v1 status is now torndown due to DeploymentManager action