Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BFD-3517: Duplicate GET Locust test suites with POST #2432

Open
wants to merge 4 commits into
base: master
Choose a base branch
from

Conversation

MahiFentaye
Copy link
Contributor

@MahiFentaye MahiFentaye commented Sep 13, 2024

JIRA Ticket:
BFD-3517

What Does This PR Do?

BFD-3517_duplicate POST Locust test suites
adds post_by_url method that takes a body parameter
when body is present, it will make a POST request instead of a GET

There is a copy of each test suit to a new POST version

What Should Reviewers Watch For?

If you're reviewing this PR, please check for these things in particular:

What Security Implications Does This PR Have?

Please indicate if this PR does any of the following:

  • Adds any new software dependencies

  • Modifies any security controls

  • Adds new transmission or storage of data

  • Any other changes that could possibly affect security?

  • I have considered the above security implications as it relates to this PR. (If one or more of the above apply, it cannot be merged without the ISSO or team security engineer's (@sb-benohe) approval.)

Validation

Have you fully verified and tested these changes? Is the acceptance criteria met? Please provide reproducible testing instructions, code snippets, or screenshots as applicable.

This has been tested against test db
locust -f v2/regression_suite_post.py --users 10 --spawn-rate 10 --spawned-runtime 30s
locust -f v1/regression_suite_post.py --users 10 --spawn-rate 10 --spawned-runtime 30s
locust -f high_volume_suite_post.py --users 10 --spawn-rate 10 --spawned-runtime 30s

@dondevun
Copy link
Contributor

@MahiFentaye Please use a little more verbosity with the PR template.

BFD-3517_duplicate-POST-Locust-test-suites
updating hashed to unhashed
@MahiFentaye MahiFentaye force-pushed the BFD-3517_duplicate-POST-Locust-test-suites branch from fde5885 to 7567282 Compare September 16, 2024 15:40
@MahiFentaye MahiFentaye marked this pull request as ready for review September 16, 2024 16:05
@dondevun
Copy link
Contributor

@MahiFentaye I think this looks good. Have you tested it?

@MahiFentaye
Copy link
Contributor Author

yes, I have tested @dondevun

dondevun
dondevun previously approved these changes Sep 17, 2024
Copy link
Contributor

@dondevun dondevun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks Good. Please update the PR template Validation section with your testing steps.

@mjburling mjburling changed the title BFD-3517_duplicate POST Locust test suites BFD-3517: Duplicate GET Locust test suites with POST Sep 17, 2024
Copy link
Contributor

@aschey-forpeople aschey-forpeople left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Whoops, just found a typo

Comment on lines 88 to 91
@tag("claim", "exclude-samsa")
@task
def get_claim_with_exclude_samsa(self):
self.__post("Claim/_search", "excludeSAMSA", True)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like a typo (or propagated typo) here, too.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like that's actually an issue with the existing code lol. So we haven't been testing with excludeSAMHSA set properly at all... fun.

Copy link
Contributor Author

@MahiFentaye MahiFentaye Sep 18, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch. yes, this two excludeSAMHSA tests don't pass for both GET and POST. It was easily missed because it doesn't say a test failed either, I had to look at the log above and see their are errors related to it.
I do see issues with hitting both Claim and ClaimResponse endpoints even after correcting the excludeSAMHSA typo. I will start a thread

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This test files were old and didn't need a post version since they aren't being used anymore, The new test files are deleted now. Thanks to Austin!

@aschey-forpeople
Copy link
Contributor

I think we also need to update app.py so that it invokes the new tests.

…that aren't used anymore adding the new regression post test suit ti app.py

BFD-3517_duplicate-POST-Locust-test-suites removing added post tests that aren't used anymore
adding the new regression post test suit ti app.py
@MahiFentaye MahiFentaye marked this pull request as draft September 20, 2024 03:28
@MahiFentaye MahiFentaye marked this pull request as ready for review September 23, 2024 15:03
@MahiFentaye MahiFentaye force-pushed the BFD-3517_duplicate-POST-Locust-test-suites branch 5 times, most recently from 1667eb1 to 20d3b65 Compare September 26, 2024 13:59
…ries add post high_volume_suite

BFD-3517_duplicate-POST-Locust-test-suites
remove unused test and queries
add post high_volume_suite
@MahiFentaye MahiFentaye force-pushed the BFD-3517_duplicate-POST-Locust-test-suites branch from 20d3b65 to 67b8de3 Compare September 26, 2024 15:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants