Shutdown handler not registered because Python interpreter is not running in the main thread
run pipeline %s
run pipeline stage %s
Running pipeline stage VLLMUploader
Starting job with name google-gemma-4-31b-it-v39-uploader
Waiting for job on google-gemma-4-31b-it-v39-uploader to finish
google-gemma-4-31b-it-v39-uploader: Traceback (most recent call last):
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1457, in from_pretrained
google-gemma-4-31b-it-v39-uploader: config_class = CONFIG_MAPPING[config_dict["model_type"]]
google-gemma-4-31b-it-v39-uploader: ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1160, in __getitem__
google-gemma-4-31b-it-v39-uploader: raise KeyError(key)
google-gemma-4-31b-it-v39-uploader: KeyError: 'gemma4'
google-gemma-4-31b-it-v39-uploader: During handling of the above exception, another exception occurred:
google-gemma-4-31b-it-v39-uploader: Traceback (most recent call last):
google-gemma-4-31b-it-v39-uploader: File "/code/uploading/compress.py", line 344, in <module>
google-gemma-4-31b-it-v39-uploader: cli()
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1485, in __call__
google-gemma-4-31b-it-v39-uploader: return self.main(*args, **kwargs)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1406, in main
google-gemma-4-31b-it-v39-uploader: rv = self.invoke(ctx)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1873, in invoke
google-gemma-4-31b-it-v39-uploader: return _process_result(sub_ctx.command.invoke(sub_ctx))
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1269, in invoke
google-gemma-4-31b-it-v39-uploader: return ctx.invoke(self.callback, **ctx.params)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 824, in invoke
google-gemma-4-31b-it-v39-uploader: return callback(*args, **kwargs)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/code/uploading/compress.py", line 36, in process
google-gemma-4-31b-it-v39-uploader: config = AutoConfig.from_pretrained(
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1459, in from_pretrained
google-gemma-4-31b-it-v39-uploader: raise ValueError(
google-gemma-4-31b-it-v39-uploader: ValueError: The checkpoint you are trying to load has model type `gemma4` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
google-gemma-4-31b-it-v39-uploader: You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`
Job google-gemma-4-31b-it-v39-uploader completed after 24.31s with status: failed
Job failed google-gemma-4-31b-it-v39-uploader:
Stopping job with name google-gemma-4-31b-it-v39-uploader
%s, retrying in %s seconds...
Starting job with name google-gemma-4-31b-it-v39-uploader
Waiting for job on google-gemma-4-31b-it-v39-uploader to finish
google-gemma-4-31b-it-v39-uploader: Traceback (most recent call last):
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1457, in from_pretrained
google-gemma-4-31b-it-v39-uploader: config_class = CONFIG_MAPPING[config_dict["model_type"]]
google-gemma-4-31b-it-v39-uploader: ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1160, in __getitem__
google-gemma-4-31b-it-v39-uploader: raise KeyError(key)
google-gemma-4-31b-it-v39-uploader: KeyError: 'gemma4'
google-gemma-4-31b-it-v39-uploader: During handling of the above exception, another exception occurred:
google-gemma-4-31b-it-v39-uploader: Traceback (most recent call last):
google-gemma-4-31b-it-v39-uploader: File "/code/uploading/compress.py", line 344, in <module>
google-gemma-4-31b-it-v39-uploader: cli()
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1485, in __call__
google-gemma-4-31b-it-v39-uploader: return self.main(*args, **kwargs)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1406, in main
google-gemma-4-31b-it-v39-uploader: rv = self.invoke(ctx)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1873, in invoke
google-gemma-4-31b-it-v39-uploader: return _process_result(sub_ctx.command.invoke(sub_ctx))
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1269, in invoke
google-gemma-4-31b-it-v39-uploader: return ctx.invoke(self.callback, **ctx.params)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 824, in invoke
google-gemma-4-31b-it-v39-uploader: return callback(*args, **kwargs)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/code/uploading/compress.py", line 36, in process
google-gemma-4-31b-it-v39-uploader: config = AutoConfig.from_pretrained(
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1459, in from_pretrained
google-gemma-4-31b-it-v39-uploader: raise ValueError(
google-gemma-4-31b-it-v39-uploader: ValueError: The checkpoint you are trying to load has model type `gemma4` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
google-gemma-4-31b-it-v39-uploader: You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`
google-gemma-4-31b-it-v39-uploader: Traceback (most recent call last):
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1457, in from_pretrained
google-gemma-4-31b-it-v39-uploader: config_class = CONFIG_MAPPING[config_dict["model_type"]]
google-gemma-4-31b-it-v39-uploader: ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1160, in __getitem__
google-gemma-4-31b-it-v39-uploader: raise KeyError(key)
google-gemma-4-31b-it-v39-uploader: KeyError: 'gemma4'
google-gemma-4-31b-it-v39-uploader: During handling of the above exception, another exception occurred:
google-gemma-4-31b-it-v39-uploader: Traceback (most recent call last):
google-gemma-4-31b-it-v39-uploader: File "/code/uploading/compress.py", line 344, in <module>
google-gemma-4-31b-it-v39-uploader: cli()
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1485, in __call__
google-gemma-4-31b-it-v39-uploader: return self.main(*args, **kwargs)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1406, in main
google-gemma-4-31b-it-v39-uploader: rv = self.invoke(ctx)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1873, in invoke
google-gemma-4-31b-it-v39-uploader: return _process_result(sub_ctx.command.invoke(sub_ctx))
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1269, in invoke
google-gemma-4-31b-it-v39-uploader: return ctx.invoke(self.callback, **ctx.params)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 824, in invoke
google-gemma-4-31b-it-v39-uploader: return callback(*args, **kwargs)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/code/uploading/compress.py", line 36, in process
google-gemma-4-31b-it-v39-uploader: config = AutoConfig.from_pretrained(
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1459, in from_pretrained
google-gemma-4-31b-it-v39-uploader: raise ValueError(
google-gemma-4-31b-it-v39-uploader: ValueError: The checkpoint you are trying to load has model type `gemma4` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
google-gemma-4-31b-it-v39-uploader: You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`
Job google-gemma-4-31b-it-v39-uploader completed after 13.44s with status: failed
Job failed google-gemma-4-31b-it-v39-uploader:
Stopping job with name google-gemma-4-31b-it-v39-uploader
%s, retrying in %s seconds...
Starting job with name google-gemma-4-31b-it-v39-uploader
Waiting for job on google-gemma-4-31b-it-v39-uploader to finish
google-gemma-4-31b-it-v39-uploader: Traceback (most recent call last):
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1457, in from_pretrained
google-gemma-4-31b-it-v39-uploader: config_class = CONFIG_MAPPING[config_dict["model_type"]]
google-gemma-4-31b-it-v39-uploader: ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1160, in __getitem__
google-gemma-4-31b-it-v39-uploader: raise KeyError(key)
google-gemma-4-31b-it-v39-uploader: KeyError: 'gemma4'
google-gemma-4-31b-it-v39-uploader: During handling of the above exception, another exception occurred:
google-gemma-4-31b-it-v39-uploader: Traceback (most recent call last):
google-gemma-4-31b-it-v39-uploader: File "/code/uploading/compress.py", line 344, in <module>
google-gemma-4-31b-it-v39-uploader: cli()
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1485, in __call__
google-gemma-4-31b-it-v39-uploader: return self.main(*args, **kwargs)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1406, in main
google-gemma-4-31b-it-v39-uploader: rv = self.invoke(ctx)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1873, in invoke
google-gemma-4-31b-it-v39-uploader: return _process_result(sub_ctx.command.invoke(sub_ctx))
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 1269, in invoke
google-gemma-4-31b-it-v39-uploader: return ctx.invoke(self.callback, **ctx.params)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/click/core.py", line 824, in invoke
google-gemma-4-31b-it-v39-uploader: return callback(*args, **kwargs)
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/code/uploading/compress.py", line 36, in process
google-gemma-4-31b-it-v39-uploader: config = AutoConfig.from_pretrained(
google-gemma-4-31b-it-v39-uploader: ^^^^^^^^^^^^^^^^^^^^^^^^^^^
google-gemma-4-31b-it-v39-uploader: File "/usr/local/lib/python3.12/dist-packages/transformers/models/auto/configuration_auto.py", line 1459, in from_pretrained
google-gemma-4-31b-it-v39-uploader: raise ValueError(
google-gemma-4-31b-it-v39-uploader: ValueError: The checkpoint you are trying to load has model type `gemma4` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
google-gemma-4-31b-it-v39-uploader: You can update Transformers with the command `pip install --upgrade transformers`. If this does not work, and the checkpoint is very new, then there may not be a release version that supports this model yet. In this case, you can get the most up-to-date code by installing Transformers from source with the command `pip install git+https://github.com/huggingface/transformers.git`
Job google-gemma-4-31b-it-v39-uploader completed after 12.07s with status: failed
Job failed google-gemma-4-31b-it-v39-uploader:
Stopping job with name google-gemma-4-31b-it-v39-uploader
clean up pipeline due to error=VLLMUploaderError('')
run pipeline stage %s
Running pipeline stage VLLMDeleter
Skipping teardown as no inference service was successfully deployed
Pipeline stage VLLMDeleter completed in 0.20s
run pipeline stage %s
Running pipeline stage VLLMModelDeleter
Cleaning model data from S3
Pipeline stage VLLMModelDeleter completed in 0.20s
Shutdown handler de-registered
google-gemma-4-31b-it_v39 status is now failed due to DeploymentManager action
google-gemma-4-31b-it_v39 status is now torndown due to DeploymentManager action
google-gemma-4-31b-it_v39 status is now failed due to DeploymentManager action
admin requested tearing down of google-gemma-4-31b-it_v39
Shutdown handler not registered because Python interpreter is not running in the main thread
google-gemma-4-31b-it_v39 status is now torndown due to DeploymentManager action
google-gemma-4-31b-it_v39 status is now deployed due to DeploymentManager action
google-gemma-4-31b-it_v39 status is now inactive due to auto deactivation removed underperforming models
google-gemma-4-31b-it_v39 status is now torndown due to DeploymentManager action