AWS shows how to stop automated updates breaking live AI services that scale automatically
Why it matters
Teams running AI endpoints on AWS can stop hand-fixing failed deployments and update live endpoints through their normal automated release process.
Ask your team
Do our SageMaker endpoint updates ever fail or need manual steps because auto scaling blocks the deployment?
What happened
AWS says that editing a live 's setup, such as machine type, machine count or settings, makes automated and deployments fail, because auto scaling has to be switched off first and CloudFormation then loses track of it. An AWS blog post describes a reusable CDK building block that turns auto scaling off and back on automatically during updates.
Tap an underlined word to see what it means.
The context No earlier Seventy story on this in the last 30 days.
Read the original at AWS Machine Learning Blog
Something wrong in this story? Report a mistake. We check it against the source within 24 hours.
Share with your take
Start from our line and make it yours. It stays on your device until you post it.
Ask about this story
Answered only from this story, with the line it came from.