Hugging Face models available in Amazon Bedrock Marketplace via SageMaker JumpStart

AI Impact Summary

Hugging Face models are now offered on Amazon Bedrock via the Bedrock Marketplace, enabling 83 open models to be deployed through SageMaker Jumpstart-managed endpoints. Deployments are created from the Bedrock console by selecting a model (e.g., Google Gemma 2 27B Instruct) and launch via a SageMaker instance such as ml.g5.48xlarge, with Bedrock API usage and SageMaker compute costs. The integration supports Bedrock APIs like Converse (via boto3) and is tied to JumpStart deployment workflows, including EULA acceptance and region availability in 14 regions. This enables rapid testing and production use of Hugging Face open models within Bedrock-driven pipelines, but requires governance around model licenses and cost planning for endpoint scale.