I am struggling with excluding tests in automated TFS run.
In settings for Test filter criteria gave but the it doesn't seem to exclude the tests in that category
($(TestFilter))&(TestCategory!~)
Also tried ($(TestFilter))&(TestCategory!=)
Any suggestions or examples on how to use the filter queries?
TIA
TFS Test Filter Criteria syntax
To exclude the tests in that category, you could set following test category filters in the VS test task:
TestCategory!=Manual
For more details about filtering pleace take a look here
Related
I am trying to decide on the structure my test cases/suites should have in TFS 2018 (and MTM).
I want to divide based on sprints eg Sprint 1 one test plan, Sprint 2 another test plan etc.
These plans might have the same test cases/ suites.
The available options I found in order to achieve this is to:
Clone the test plan A and create a test plan B by selecting which test suites i want to bring to the new plan.
Create test suites by referencing
Add existing test cases to test plan
The first way is good because the new plans are separate from the old ones so if i delete or make changes to the new test cases it won't update or delete the original ones in the previous sprint. The problem with this way though, is that if i want to add in a later phase some tests from a previous sprint there is no way to clone it in that specific new sprint (it always create a new one as far as I know)
The other two ways are good because you can add anytime new test cases or test suites from the previous to the new sprint but in case you want to delete a test case /suite from the new test plan, it will delete this test suite/case from the previous test plan as well. And i would like to avoid that so that i know what exactly i have run in previous sprints.
A fourth way which i don't think it is a good way, it is to just have a single test plan with different folders for each sprint and just copy test cases between the folders.
What is the best way to achieve what I want ?
There will be only one test plan. And it will have test suites and all your test cases under them.
Test Suite1 (12 test cases)
Ready (5)
NotReady (7)
Every time, you just move the test cases between these Ready, NotReady folders. And every time you will execute only test cases in "Ready" folder.
In sprint 1, if you want to execute test cases 1,2,5,6 only. Then move only 1,2,5,6 test cases to "ready" folder and the rest in to "NotReady" folder.
Hello,
I am trying to write an SQL query to list all tags along with the number of how many times they were used in Work Items in TFS2015.
I cannot find the connection between tbl_WorkItemCoreLatest, tbl_PropertyDefinition and tbl_TagDefinition that would point me to tags used on work items.
I tried to go with the solution from here, but with no success. The query results seems not to match what I see directly in VSTS (eg. searching for a particular tag returns me work items from which some don't have that particular tag, almost as if TFS would store previous states of work items...?)
If there's a way to do that with REST API, that will work as well.
Any help will be much appreciated.
You can use TFS REST API below to get all work items with System.Tags field, then calculate how many times they were used：
`http://tfs2015:8080/tfs/DefaultCollection/teamproject/_apis/wit/reporting/workitemrevisions?fields=System.Tags&includeLatestOnly=true&api-version=2`
Another simple way is creating a work item query with Tags column and open this query in Excel to filter the Tags column.
I have one Excel file in which there is Test Case Name, Test Case description, Data, Flag and Result.
I want to execute only those test cases which have Flag set as 'Y' and skip rest of all the test cases where Flag is equal to 'N'.
Also, once executed need to write the Status as Pass/Fail/Skipped.
Is it possible to achieve by Selenium?
Any help/code would be appreciated. If someone has done this in his/her framework kindly share the logic.
How to calculate Jenkins pass and fail percentage of build's?
I have one Jenkins job and it ran 100 times in one week.
I want to calculate automatically number of percentage the times it pass and it fail.
You can check this answer:
Jenkins Build Stability/Statisitics Report plugin
In case you don't want to use a plugin you can always get the interested stat just greping the job xml files in the file system.
You got all the builds of a particular job under:
JENKINS_HOME/JOB_NAME/builds
Once there you will have a list of builds (depending by your retention):
39
40
41
Inside everyone of them you can find the build.xml with the information about the build, this approach can be useful if you need to elaborate in a custom way the dates, in fact you can put them into a DB or plan file and analyse them or produce all the stats you want
We have about 10 tfs reports around work items that filter on "Iteration Path" multiple times. Every sprint we have to make 25-30 edits to the reports to get them to query the new sprint. Sometimes we miss changing one or two.
AND [Iteration Path] = [Product\R2016\December 2015 - R16 - Dev]
Is there a quicker and more consistent way to accomplish this?
Can you define a constant for the reports to use or something similar?
There is no way to modify multiple reports at a time. You have to filter "Iteration Path" field or modify the "Iteration Path" parameter manually.