Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name chaiml-gspo-glm47-combin-1575-v1-uploader
Waiting for job on chaiml-gspo-glm47-combin-1575-v1-uploader to finish
chaiml-gspo-glm47-combin-1575-v1-uploader: Using quantization_mode: fp8
chaiml-gspo-glm47-combin-1575-v1-uploader: Checking if ChaiML/gspo-glm47-combine-rm82-zy-data-step400-FP8 already exists in ChaiML
chaiml-gspo-glm47-combin-1575-v1-uploader: Downloading snapshot of ChaiML/gspo-glm47-combine-rm82-zy-data-step400...
2026-03-17T19:07:26.277056+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:08:26.370299+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:09:26.473222+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:10:26.579322+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:11:26.686097+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
chaiml-gspo-glm47-combin-1575-v1-uploader: Downloaded in 278.936s
chaiml-gspo-glm47-combin-1575-v1-uploader: Loading /tmp/model_input...
chaiml-gspo-glm47-combin-1575-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-combin-1575-v1-uploader: `torch_dtype` is deprecated! Use `dtype` instead!
2026-03-17T19:12:26.791548+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
chaiml-gspo-glm47-combin-1575-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
chaiml-gspo-glm47-combin-1575-v1-uploader: Applying quantization...
chaiml-gspo-glm47-combin-1575-v1-uploader: The tokenizer you are loading from '/tmp/model_input' with an incorrect regex pattern: https://huggingface.co/mistralai/Mistral-Small-3.1-24B-Instruct-2503/discussions/84#69121093e8b480e709447d5e. This will lead to incorrect tokenization. You should set the `fix_mistral_regex=True` flag when loading this tokenizer to fix this issue.
chaiml-gspo-glm47-combin-1575-v1-uploader: 2026-03-17T12:12:40.491857-0700 | reset | INFO - Compression lifecycle reset
chaiml-gspo-glm47-combin-1575-v1-uploader: 2026-03-17T12:12:40.561256-0700 | from_modifiers | INFO - Creating recipe from modifiers
2026-03-17T19:13:26.897036+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
chaiml-gspo-glm47-combin-1575-v1-uploader: 2026-03-17T12:13:37.282240-0700 | initialize | INFO - Compression lifecycle initialized for 1 modifiers
chaiml-gspo-glm47-combin-1575-v1-uploader: 2026-03-17T12:13:37.282727-0700 | IndependentPipeline | INFO - Inferred `DataFreePipeline` for `QuantizationModifier`
chaiml-gspo-glm47-combin-1575-v1-uploader: Some parameters are on the meta device because they were offloaded to the cpu.
2026-03-17T19:14:27.001484+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:15:27.110031+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:16:27.217340+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:17:27.324572+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:18:27.432572+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:19:27.541142+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
2026-03-17T19:20:27.652807+00:00 monitor updated for chaiml-gspo-glm47-combin_1575_v1
chaiml-gspo-glm47-combin_1575_v1 status is now deployed due to DeploymentManager action
chaiml-gspo-glm47-combin_1575_v1 status is now inactive due to auto deactivation removed underperforming models
chaiml-gspo-glm47-combin_1575_v1 status is now torndown due to DeploymentManager action