Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support auto scaling on Model Service #2659

Open
3 tasks
kyujin-cho opened this issue Aug 6, 2024 · 0 comments
Open
3 tasks

Support auto scaling on Model Service #2659

kyujin-cho opened this issue Aug 6, 2024 · 0 comments
Assignees
@kyujin-cho
Labels
type:feature Add new features

Comments

@kyujin-cho
Copy link
Member

kyujin-cho commented Aug 6, 2024 •
edited
Loading

Main idea

Support for auto scaling is crucial when serving production-grade model service APIs. We can think of supporting the feature by two approaches: Metric-based and Schedule-based.

Tasks
Beta Give feedback

Alternative ideas

No response

Anything else?

No response
@kyujin-cho kyujin-cho added the type:feature Add new features label Aug 6, 2024
@kyujin-cho kyujin-cho self-assigned this Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@kyujin-cho kyujin-cho

Labels
type:feature Add new features
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@kyujin-cho