TestComplete 8 and TFS 2010 Lab Management - testing

I'm tryng to run TestComplete 8 tests with TFS 2010 Lab Management and I keep getting following error when running tests:
File extension specified '.tc8test' is not a valid test extension.
I can't seam to find any solution for this problem.

Did you install TestComplete (with TFS integration modules) on the Test Agent PC, and the PC where you are configuring your tests (where Visual Studio is installed)?

Related

command line MSBuild works - remote build produces errors

I am setting up a process to build remotely a suite of COBOL programs. A virtual machine has Visual Studio 2017 installed along with a Micro Focus COBOL Enterprise Developer 4.0 Visual Studio 2017 plugin. The programs use CICS as their UI and work with a Microsoft SQL Server backend. Opening a developer command prompt in Visual Studio and issuing a MSBuild command with the solution as the parameter successfully builds the programs. A remote build does not - the error is
MSBUILD : error MSB4025: The project file could not be loaded. Root element is missing.
any ideas?
You need to install the "Micro Focus Enterprise Developer Build tools" on the CI machine.

How to setup automation testing project in visual studio 2017 using C# & How to RUN the Test Scripts in TFS

Environment is
1. Visual Studio 2017
2. Visual Studio Team server
In My requirement is, If i update "TEST SCRIPTS" code in Visual Studio Team server its will build automatically every release. But i need to to RUN the updated "TEST SCRIPTS" in Visual Studio Team server.
There are many tasks to run test, such as Visual Studio Test, Maven Test, Run Functional Test. So you can create a unit test/coded UI test project in VS 2017 and run the test through Visual Studio Test task.
Related article: Get started with continuous testing.
I recommend you run the test during the build.
Regarding run the test once the Test Script code be changed, you can setup a CI build (Triggers tab). If you want to do test in release, you need to publish artifact (test project build result), and configure release with Continuous Deployment mode (Triggers)

Where is the ISO for Test Agents for Visual Studio 2015?

We have TFS2015 and I am trialling Visual Studio Enterprise 2015 (no installation disk).
I am now looking for an ISO with Microsoft Test Agents for Visual Studio 2015.
Documentation for VS 2015 states that these ISOs should be available:
I can get the web installer (exe) for the Agents from here, but where can I get the ISO?
Please note: I need the ISO to get hold of Test Controller 2015 to run Load Tests, so just having the Agents is not enough.
Also, I have tried using Test Agents 2015 with Test Controller 2013, and my Agent configuration fails with a time out (whilst attempting to restart the service).
And finally, I have tried using Test Agents 2013 with TFS2015, which fails with a "Registry lookup failed" error on the "Agent Deployment" build step in our build definition (the powershell scripts used in this step assume that there is a path for an installed Test Agent 2015 in your registry). This problem is fixed by providing a path to Test Agent 2015 installer in "Test Agent Location" property of that build step.
So, I am now trying to locate the ISO with Test Agents for Visual Studio 2015 - does anybody know where I can get it from, please?
It was announced that Test Agent 2015 no longer needed a Test Controller, as the agent orchestration now is managed by the server (TFS or VSTS). You can also refer this post.
Q: Will the Test Agent 2015 support all the scenarios supported by
Test Controller and Test Agent of Visual Studio 2013?
A: We recommend you use Agents for Visual Studio 2015 in all the new automated testing scenarios. You can use the Deploy Test Agents task in a build definition to download and install the test agents on your machine. The following table shows the scenarios supported by Agents for Visual Studio 2013 and the alternatives for Team Foundation Server (TFS) 2015 and Team Services (TS).
For your situation, seems you are using on-premises Load Test , you need to use Test Controller/Test Agentes2013 Update5 . More information, please refer Using a Test Controller and Test Agents in a Load Test
As for ISO files, it seems agent for VS2013
are using the .iso including test agents and test controls in download center. But for agent for Vs2015 are just using .exe in download center.
Yes, of course, go to the page below:
https://www.visualstudio.com/vs/older-downloads/
at the scroll down the page you will see VS2015, after clicking download you will need to sign in,
then could choose the corresponding version you want to download:
do remember to sign in to Microsoft for downloading agents.
https://my.visualstudio.com/Downloads?q=Visual%20Studio%202015%20Update%203

TFS Test Agent Configuration Tool for Selenium UI tests

My team has several Selenium Unit Tests that we run locally. Selenium opens a browser and runs through our application. This works fine locally. Now, management wants to run the tests, on demand, via TFS. Should be easy, right? WRONG!
I am having trouble setting up our TFS 2015 server to run these Selenium UI tests.
Everything I read tells me to run the "Test Agent for Visual Studio 2015" tool. Problem is, the tool does not exist on my machine and I cannot understand why. I have tried many things, like installing the MS Visual Studio "Agents", with no luck.
When I try to open the freshly installed "Agents" I get a message saying: "Test Agent for Visual Studio 2015 has no configuration tool".
So the VS.NET "Agents" panel never opens. Seems bizarre to me that I installed something that needs further configuration, with no way to perform that configuration.
From further reading, I think I need to provision a group machine in the TFS web administration page, but am totally unsure if that's required for my situation, as I cannot even get past the basics here.
I see other people have had this problem, with very little response or help from Microsoft. I am a little baffled at why this seems so very difficult to do on a TFS server? It runs locally just fine, like a breeze. But TFS? It's like a giant puzzle.
Once this is working, I need to configure the test agent to run in "interactive mode" so it can run the browser but I cannot even begin to figure that out yet. Where do you set it to "run interactive" because I dont see any of those options. Am I missing TFS installation components? Do I have the wrong Visual Studio? Do I need the Ultimate edition of Visual Studio to be able to perform UI tests with the browser? We have the Professional edition.
Here is someone with the same problem:
https://connect.microsoft.com/VisualStudio/feedback/details/1712725/test-agent-for-visual-studio-2015-has-no-configuration-tool
Does anyone have any ideas or instructions on how to setup the "Test Agent" I need to run my team's existing Selenium UI tests in TFS2015? Seems very difficult when it should not be.
In the link you provided, Allen has explained that "There is no configuration UI with the test agent anymore. This is because we have simplified the existing remote testing scenario by doing the install and configuration for you when running via the build pipeline."
TFS 2015 Update2 now have a "Run Functional Test" task that you can use to run tests (included Coded UI Tests) against machine groups. So, first you have to upgrade your TFS 2015 to TFS 2015 Update2 if you haven't.
The tasks you need for test scenarios using Visual Studio 2015 and Visual Studio Team Services (VSTS) or Team Foundation Server (TFS) 2015:
Create environments from physical or virtual machines that you've already set up.
Set up your build to run your app and tests in the environments that you created.
After your build finishes, review your test results to start resolving problems that you found.
So, your build process template should look like the screenshot below. You need to specify every task to meet the requirement of your project. All TFS tasks can be found at this website, you can get more information for each task from it. Coded UI or Selenium tests that are running on full fidelity browsers would need Interactive Process checked.:

MSBuild SonarQube Runner: "Failed to locate the code coverage command line tool" still with version 1.0.1

I am trying to use MSBuild SonarQube Runner to have my TFS-builds run the Sonar analysis.
I have configured the tool to work with our sonar Server according to this manual. Actually I can start an analysis by building manually via console on my local machine. Additionally, I installed the tool on our build server and when I run it via Visual Studio, I’ll get the error "Failed to locate the code coverage command line tool".
I already found out that the CodeCoverage.exe is needed, but only given with installing an Enterprise version of Visual Studio on the server. I also read that in version 1.0.1, this issue should be fixed (see here and in the changelog this is also mentioned as fixed).
I exchanged the old MSBuild SonarQube Runner with the version 1.0.1, but with building on the TFS in Visual Studio and adding the command lines to run MSBuild SonarQube Runner v1.0.1, I still get the error "Failed to locate the code coverage command line tool".
I also have Visual Studio 2015 Professional installed on the build mashine.
How can I fix this issue without needing an Enterprise version of Visual Studio providing the CodeCoverage.exe?
Code Coverage still requires Visual Studio Enterprise in the 2015 version (see this page).
The bug you referred to fixed an issue in version 1.0 that meant that analysis would fail if the code coverage tool could not be found. Analysis will no longer fail if the code coverage tool was not found, but it doesn't change the requirement to have to VS Enterprise installed if you want to use the Microsoft code coverage tools.