We use TFS 2015 vNext as our build system. However we use dotCover from JetBrains as our code coverage tool. The reason we don't use the built-in TFS code coverage tool is that this requires an Enterprise licence and we only have Professional licences (and upgrading is not an option).
Is it possible to display code coverage from a different code coverage tool to be displayed on the build results page in TFS 2015 (as in the screen shot below)?
Possible duplicate with this question Display OpenCover results in TFS 2015 build Summary .Your requirement could be achieved after TFS2015 update2.
If you want to display your custom result in the build result summary,
seems you will have to write your own extensions. Help link:
Overview of extensions for Visual Studio Team Services
Base for this were a lot of examples provided by MS on github:
Visual Studio Team Services Tasks
Visual Studio Team Services Sample Extensions
To get a first feeling what places on your TFS Web Portal can be
extended/customized you can download and install this extension
Contributions Guide from the Visual Studio Marketplace.
Related
We have TFS2015 and I am trialling Visual Studio Enterprise 2015 (no installation disk).
I am now looking for an ISO with Microsoft Test Agents for Visual Studio 2015.
Documentation for VS 2015 states that these ISOs should be available:
I can get the web installer (exe) for the Agents from here, but where can I get the ISO?
Please note: I need the ISO to get hold of Test Controller 2015 to run Load Tests, so just having the Agents is not enough.
Also, I have tried using Test Agents 2015 with Test Controller 2013, and my Agent configuration fails with a time out (whilst attempting to restart the service).
And finally, I have tried using Test Agents 2013 with TFS2015, which fails with a "Registry lookup failed" error on the "Agent Deployment" build step in our build definition (the powershell scripts used in this step assume that there is a path for an installed Test Agent 2015 in your registry). This problem is fixed by providing a path to Test Agent 2015 installer in "Test Agent Location" property of that build step.
So, I am now trying to locate the ISO with Test Agents for Visual Studio 2015 - does anybody know where I can get it from, please?
It was announced that Test Agent 2015 no longer needed a Test Controller, as the agent orchestration now is managed by the server (TFS or VSTS). You can also refer this post.
Q: Will the Test Agent 2015 support all the scenarios supported by
Test Controller and Test Agent of Visual Studio 2013?
A: We recommend you use Agents for Visual Studio 2015 in all the new automated testing scenarios. You can use the Deploy Test Agents task in a build definition to download and install the test agents on your machine. The following table shows the scenarios supported by Agents for Visual Studio 2013 and the alternatives for Team Foundation Server (TFS) 2015 and Team Services (TS).
For your situation, seems you are using on-premises Load Test , you need to use Test Controller/Test Agentes2013 Update5 . More information, please refer Using a Test Controller and Test Agents in a Load Test
As for ISO files, it seems agent for VS2013
are using the .iso including test agents and test controls in download center. But for agent for Vs2015 are just using .exe in download center.
Yes, of course, go to the page below:
https://www.visualstudio.com/vs/older-downloads/
at the scroll down the page you will see VS2015, after clicking download you will need to sign in,
then could choose the corresponding version you want to download:
do remember to sign in to Microsoft for downloading agents.
https://my.visualstudio.com/Downloads?q=Visual%20Studio%202015%20Update%203
I haven't been able to find anything about this directly online. I am about to make an automated Chocolatey script for build agent configuration.
Is MsTest part of Microsoft Build Tools?
I figured out that it is not the case. Visual Studio 2015 is needed, or you can choose to install something Microsoft released separately, called Microsoft Test Agents 2015.
Is it possible to use FxCop for .NET 4.5 applications?
I am looking to use FxCop with the Visual Studio 2013 Professional edition.
Visual Studio 2013 Professional comes with Static Code Analysis (which is FxCop, just a fancy name for it).
In this link some information is provided:
As a developer, you can run code analysis on your project automatically or you can run it manually.
To run code analysis each time that you build a project, you select Enable Code Analysis on Build (defines CODE_ANALYSIS constant) on the project's Property Page. For more information, see How to: Enable and Disable Automatic Code Analysis for Managed Code.
To run code analysis manually on a project, on the Analyze menu, click Run Code Analysis on ProjectName. For more information, see How to: Enable and Disable Automatic Code Analysis for Managed Code.
This version runs perfectly on .NET 4.5.
FxCop 1.36 is a standalone version of Code Analysis. Microsoft no longer supports or works on the standalone version and currently only working on the integrated version that is included in Visual Studio.
There is a Uservoice going on which asks Microsoft to update the standalone FxCop version. See this link.
I am testing web based products, and I am new to Microsoft tools. I am trying to figure out how test plan creation works, or can work depending on what configuration of Visual Studio tools I am using. I find a lot of conflicting info online.
I have the three tools below installed right now, but I can request something different if I need it. (Feel free to suggest). Any advice from pros more experienced with this tool set would be GREAT.
I access Team Foundation Server 2012 via my browser, where I can view and add product backlog items, bugs, sprints, the board etc. I cannot add test plans here, but I can add test cases to them.
I have Visual Studio 2013 installed on my PC. This seems like pretty much the same thing as the browser accessible tool, and I don't use it much because I find it easier to work from the browser for testing web.
I have Microsoft Test Manager 2012 installed on my PC. This appears to be the only place where I can create test plans, cases, and can create and utilize shared test case steps.
Questions:
How can I create test plans using the browser tool?
Is it possible to update the TFS 2012 Browser Tool to 2013, and how is that done?
Additionally to the #jessehouwing answer I would highly recommend you this free ebook:Testing for Continuous Delivery with Visual Studio 2012
Team Foundation Server 2012 update 2 adds Web Based test Case Management to TFS 2012, this is a smaller step than an upgrade to TFS 2013 all the way. You cannot just upgrade the Web Access part of a TFS installation, it would require a complete upgrade of the cluster. You also cannot just install this to your machine, it has to be installed on all the TFS servers in the cluster.
Traditionally Test Manager is the place to go to to do Test Suite Management and to view the results of a test run. Microsoft has started to move the functionality traditionally found in Test manager to the Web portal, It seems you're not the only person who found that easier to use. This transition started with TFS 2012 update 3 and was further expanded with TFS 2013.
So your options are:
Use Test Manager (you'll have to use it to manage certain things you cannot yet do on the web anyway).
Ask your Server Administrator to upgrade TFS 2012 to at least Update 2 (I'd recommend he upgrades to TFS 2012 update 4 or TFS 2013 in any case).
Ask your Server Administrator to upgrade TFS 2012 to TFS 2013.
The following resources can be very helpful in understandign how to use the tools to their fullest potential:
Visual Studio ALM Rangers' Test Guidance
Patterns & Practices' Testing for Continuous Delivery with Visual Studio 2012 (as mentioned by #Elena)
Microsoft Virtual Academy Software Testing with Visual Studio 2012 (exam 70-497 jump start)
I am trying to build and deploy an SSRS project (rptproj) but MSBuild does not support this project type. What can I use to build and deploy this project?
I looks like I can use RS.EXE and Dev Env. What are the benefits of each?
It actually is recommended to install Visual Studio on the TFS Build machine to support building various types of projects that MSBuild alone does not support. You don't have to worry about licensing because as long as you have a Visual Studio license then you can put it on all of your machines.
You can find more details here.