Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gspo-glm47-cas72-44480-v1-uploader
Waiting for job on chaiml-gspo-glm47-cas72-44480-v1-uploader to finish
chaiml-gspo-glm47-cas72-44480-v1-uploader: Using quantization_mode: fp8
chaiml-gspo-glm47-cas72-44480-v1-uploader: Checking if ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step500-FP8 already exists in ChaiML
chaiml-gspo-glm47-cas72-44480-v1-uploader: Downloading snapshot of ChaiML/gspo-glm47-cas72b-combine-rm82-kimi-data-step500...
2026-03-21T21:30:45.987142+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
2026-03-21T21:31:46.152309+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
2026-03-21T21:32:46.238108+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
2026-03-21T21:33:46.319405+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
chaiml-gspo-glm47-cas72-44480-v1-uploader: Downloaded in 231.389s
chaiml-gspo-glm47-cas72-44480-v1-uploader: Loading /tmp/model_input...
chaiml-gspo-glm47-cas72-44480-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-cas72-44480-v1-uploader: `torch_dtype` is deprecated! Use `dtype` instead!
2026-03-21T21:34:46.400672+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
chaiml-gspo-glm47-cas72-44480-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-gspo-glm47-cas72-44480-v1-uploader: Applying quantization...
chaiml-gspo-glm47-cas72-44480-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-cas72-44480-v1-uploader: 2026-03-21T14:35:14.125794-0700 | reset | INFO - Compression lifecycle reset
chaiml-gspo-glm47-cas72-44480-v1-uploader: 2026-03-21T14:35:14.195481-0700 | from_modifiers | INFO - Creating recipe from modifiers
2026-03-21T21:35:46.487734+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
chaiml-gspo-glm47-cas72-44480-v1-uploader: 2026-03-21T14:36:11.134766-0700 | initialize | INFO - Compression lifecycle initialized for 1 modifiers
chaiml-gspo-glm47-cas72-44480-v1-uploader: 2026-03-21T14:36:11.135231-0700 | IndependentPipeline | INFO - Inferred `DataFreePipeline` for `QuantizationModifier`
2026-03-21T21:36:46.569377+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
chaiml-gspo-glm47-cas72-44480-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
2026-03-21T21:37:46.653672+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
2026-03-21T21:38:46.754585+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
2026-03-21T21:39:46.838813+00:00 monitor updated for chaiml-gspo-glm47-cas72_44480_v1
chaiml-gspo-glm47-cas72_44480_v1 status is now deployed due to DeploymentManager action
chaiml-gspo-glm47-cas72_44480_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-gspo-glm47-cas72_44480_v1 status is now inactive due to Froze recruitment for AB test 0321_curry
chaiml-gspo-glm47-cas72_44480_v1 status is now torndown due to DeploymentManager action