When I run test cases individually, values are updated in Global Properties.
When I run test suite which contains 2 test cases by using test runner, at the time values aren't updated in Global Properties.
I am still able to see the old values which were generated when I ran the individual test cases.
Related
How to handle the remove flight booking in webtours? It came to my mind that if I wanna run the test with 3 virtual users and how they supposed to delete the booking if the information down here (refer below) are unique for each virtual user? Does any of these variables below need to be parameterized or need to apply correlation?
If there are multiple flight id to be deleted, we can create a CSV file having those ids
and use a while loop controller to delete each of them.
You may refer -
https://guide.blazemeter.com/hc/en-us/articles/206733689-Using-CSV-DATA-SET-CONFIG
https://www.blazemeter.com/blog/using-while-controller-jmeter
As you said, it will differ for a different user, you can store each value from the response of each user(extract value using regex) and pass them in delete call.
reference link - https://guide.blazemeter.com/hc/en-us/articles/207421325-Using-RegEx-Regular-Expression-Extractor-with-JMeter-Using-RegEx-(Regular-Expression-Extractor)-with-JMeter
I don't know what "webtours" is, however there is one "golden" rule: each and every parameter which is dynamic needs to be correlated.
If you don't have any idea regarding which ones are dynamic - record the same action one more time using JMeter's HTTP(S) Test Script Recorder and compare the generated requests, parameter values (or even names) which differ needs to be correlated.
Another approach is to inspect the previous response(s) using View Results Tree listener and look if the data is present there
Check out Advanced Load Testing Scenarios with JMeter: Part 1 - Correlations article for more information and example implementation
I am trying to decide on the structure my test cases/suites should have in TFS 2018 (and MTM).
I want to divide based on sprints eg Sprint 1 one test plan, Sprint 2 another test plan etc.
These plans might have the same test cases/ suites.
The available options I found in order to achieve this is to:
Clone the test plan A and create a test plan B by selecting which test suites i want to bring to the new plan.
Create test suites by referencing
Add existing test cases to test plan
The first way is good because the new plans are separate from the old ones so if i delete or make changes to the new test cases it won't update or delete the original ones in the previous sprint. The problem with this way though, is that if i want to add in a later phase some tests from a previous sprint there is no way to clone it in that specific new sprint (it always create a new one as far as I know)
The other two ways are good because you can add anytime new test cases or test suites from the previous to the new sprint but in case you want to delete a test case /suite from the new test plan, it will delete this test suite/case from the previous test plan as well. And i would like to avoid that so that i know what exactly i have run in previous sprints.
A fourth way which i don't think it is a good way, it is to just have a single test plan with different folders for each sprint and just copy test cases between the folders.
What is the best way to achieve what I want ?
There will be only one test plan. And it will have test suites and all your test cases under them.
Test Suite1 (12 test cases)
Ready (5)
NotReady (7)
Every time, you just move the test cases between these Ready, NotReady folders. And every time you will execute only test cases in "Ready" folder.
In sprint 1, if you want to execute test cases 1,2,5,6 only. Then move only 1,2,5,6 test cases to "ready" folder and the rest in to "NotReady" folder.
This question is very similar to this post however I am trying to identify the specific id of the test result during the execution of the test. This is so that I can mark the screen shot with the specific id and attach it to the test run result after the execution. (This is, in turn, because the REST API does not return any results until the execution is complete.)
I am looking for a way to get the id's of the individually highlighted items during their execution:
Currently, I retrieve id's such as the release id during its execution like this:
Environment.GetEnvironmentVariable("RELEASE_RELEASEID")
But I do not know how to get information about the tests at that time.
Test cases are created in iterations with our sprint cycles. They are then added to a test plan via requirements-based query for our integration and system testing.
At the end of every sprint and leading up to integration and system testing, the requirements-based query is run repeatedly against the same same static test suite to add any newly created test cases to the test plan.
The requirements-based query will see the new items and add them to the test plan, however, anywhere that displays the total count of test cases in the test plan or suites does not update automatically. This includes counts shown in TFS web GUI ("Show count from child tests"), MTM, and any dashboard charts.
The only way to get that count to update is to manually click on each test suite generated from the requirements-based suite.
Repro Steps:
Create Test Plan - "Test Plan A"
Create Static Suite in newly created Test Plan - "Static Suite B"
Right click on "Static Suite B" and select "New requirements-based suite"
Fill out criteria for requirements-based suite. My query: Top Level: 'Work Item Type - In Group - Feature/Requirement/Bug Categories' and 'Release Number = XX.XX'. Linked Work Items: 'Work Item Type = Test Case'. 'Return all top level items' is selected.
Run query. Results display in grid, including top level items that do not yet have test cases but are assigned to upcoming release.
Select all results in the grid.
Select "Create Suites". Suites are created for all items included in the release, including items that do not yet have test cases. Note the total count of test cases in "Static Suite B". This count will display in any charts for this test plan and/or suite.
Add a test case for an item that is included in the release but did not have a test case during prior step. Note the top level item for upcoming step.
Navigate back to "Test Plan A".
Right click on "Static Suite B" and select "New requirements-based suite"
Query used in Step 4 displays. Do not make any changes to the query.
Run query again. Results display in grid for all top level items, including those that do not yet have test cases but are assigned to upcoming release. Newly created test case should display in the results.
Select all results and select "Create Suites". No new suites are created since they were created in Step 6 above. Do not select existing requirements based suite for the test case that was added in Step 8.
Check the total count of test cases in "Static Suite B" and any test plan/suite charts. Observe count has not incremented per new test case.
Navigate to "Static Suite B" and select the requirements-based suite where test case was added in Step 7. Observe test case displays in the requirements-based suite as expected.
Check the total count of test cases in "Static Suite B" and any test plan/suite charts. Observe count is not incremented per new test case.
Screenshot of requirements-based query and results (obfuscated)
Screenshot of counts that do not update (obfuscated)
Has anyone else encountered this and have a fix/work-around?
Using local TFS Version 16.122.27102.1.
I have one Excel file in which there is Test Case Name, Test Case description, Data, Flag and Result.
I want to execute only those test cases which have Flag set as 'Y' and skip rest of all the test cases where Flag is equal to 'N'.
Also, once executed need to write the Status as Pass/Fail/Skipped.
Is it possible to achieve by Selenium?
Any help/code would be appreciated. If someone has done this in his/her framework kindly share the logic.