Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

angr not giving the expected precision and recall #18

Open
AnjaliPare opened this issue Sep 1, 2022 · 1 comment
Open

angr not giving the expected precision and recall #18

AnjaliPare opened this issue Sep 1, 2022 · 1 comment

Comments

@AnjaliPare
Copy link

Hi,
I have been using the compareCFG script to see the precision and recall for angr compared to the ground truth. The paper mentions that for any optimization, the precision and recall for the edges ranges from ~95% to ~98%. However, I do not get similar results when I run the same locally, and the precision and recall that I get are pretty low.
I understand that angr splits basic blocks at function calls which may lead to the difference in results between the ground truth and angr.
Is there any setting that I need to enable or another script that I need to run in order to get the results mentioned in the paper?

Thank you for your help!

@bin2415
Copy link
Collaborator

bin2415 commented Sep 2, 2022

Hello, we run angr with normalize=True and detect_tail_calls=True.

I understand that angr splits basic blocks at function calls

Yes, we merge the edges when comparing with angr to avoid the difference. And I just upload the script that merges the fall-through edges after the return call sites.

@AnjaliPare AnjaliPare changed the title Angr not giving the expected precision and recall angr not giving the expected precision and recall Oct 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants