less flexible types to reduce matmul overhead

less flexible types to reduce matmul overhead #1808