How to obtain the mtrics of PAB

[LiewFeng]

PAB is a really useful work and I wonder how obtain the mtrics of PAB. Thanks a lot!

[oahzxl]

do you mean the evaluation results? it's in the eval dir

[LiewFeng]

Yes. I notice the files in the eval dir but there is no instruction file and could you provide more detailed instructions? Thanks!

[oahzxl]

sure will soon

[oahzxl]

guide for eval is updated now: https://github.com/NUS-HPC-AI-Lab/VideoSys/blob/master/eval/pab/README.md

[LiewFeng]

Thanks! Shoud 'enable_flash_attn' be True by default? Since 'We enable FlashAttention (Dao et al., 2022) by default for all experiments.' is claimed in the paper.

[oahzxl]

currently torch already support flash attention. so we dont require to install flashattn manually.