Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

unreasonable accuracy numbers for vgg8 #2

Open
sbastani opened this issue Mar 9, 2021 · 2 comments
Open

unreasonable accuracy numbers for vgg8 #2

sbastani opened this issue Mar 9, 2021 · 2 comments

Comments

@sbastani
Copy link

sbastani commented Mar 9, 2021

I have downloaded the weight parameters of vgg8 from the link provided in the manual.
When I run the example vgg8 use-case in the manual using MNSIM 2.0 with the default hardware settings (e.g. no device non-ideality) it shows original accuracy of 10.8% (more specifically, Original accuracy: 0.10818181818181818) and PIM-based computing accuracy: 0.10818181818181818. I ran the simulation on CPU.
My questions are:
1- What does the original accuracy mean? Is it pure software based accuracy?
2- Is the low accuracy of the vgg8, as described above, expected?

@sbastani
Copy link
Author

Will this repo be maintained, and issues will be addressed or is it just a one-time publication-purposed repo?

@frankinwi
Copy link

frankinwi commented Apr 15, 2021

@sbastani Same problem. @Zhu-Zhenhua Can the author provide more details about how to reproduce the results listed in the paper, e.g., 90.18% accuracy for the VGG-8 model with R=8?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants