Dynamic Batching

[lianzhang132]

Hello, dear developers, I did not find the relevant code about Dynamic Batching_size technology in the source code?If so, please reply, thanks

[dyoung23]

I focus on this project from their paper,I think some features like batching are not implemented.
These days,I look back this project,I think we can follow their ideas to implement these features by ourselves.

[pavin]

I found 'batch_size' in build_and_deploy_model function.
If the default value of -1 is used, Clipper will adaptively calculate the batch size .
But I couldn't find infomations about model selecction layer.