Is there a way to display all tests names in Bamboo, instead of only the names of the failed/fixed tests. When I browse to the tests section of the result page of the build, only the total number of tests is displayed, e.g. '30 tests in total'. What I actually want to see is a list of all tests performed.
Go to your build results, choose the test tab and click on the small arrow on the left of the screen.
A navigator will show up.
Click on the job for which you want to see the test results and a list with all tests will show up in the right part of the screen.
The way I did this was to go to the Logs section for the test, and click Download.
Then, for TestNG which reports PASSED/FAILED I did:
grep -P "(PASSED|FAILED):" xxxxx.log
I agree though, it would be helpful to see which tests actually ran from within Bamboo.
Related
I am using TFS 2018 to run manual test cases (on chrome browser). When I run a manual test, the Microsoft Test runner opens in a popup window. I mark the result of each test step, mark the test case result, and then save and close it. The Microsoft Test runner window closes, however, the Outcome value displayed for the test I ran is set to In progress on the TFS web page. Why is that?
test outcome after save and close
When I go to the run summary, it also shows outcome of in progress and the running time will continue to advance indefinitely. if I click on the test results tab within the run, it is showing the outcomes selected in the test runner for the test and its steps. There doesn't appear to be a way to update the outcome of the run either.
run summary ss
Turns out the issue was with Chrome. Had to change the #allow-sync-xhr-in-page-dismissal setting from default to enabled.
I would like to test a button click event of a web page in different tabs of browser.
Let's say I have button named as Save Details in URL: http://example.org/UserDetails
Now I open the same URL in two different tabs in Chrome browser window.
I would like to click Save Details button in different tabs at same time. How is this possible ? Can I do this using selenium tool ?
Being a ASP.NET developer , I am new to testing tools. Any help would be great.
Update:
I want to simulate users clicking the same button in different browser or same browser different window at same time.
Selenium is just an FT tool and it can perform single operation just like humans at a time on a webelement in non parallel run. So, at the same time it cannot perform click operation on two different tabs in same browser window.
For your use case, you need to depend on any other framework like TestNG along with selenium. TestNG has parallel run feature which allows you to trigger multiple test case at the same time. So, in your scenario, the same test case needs to be defined twice or can be duplicated and include both the test case in Testng.xml from where execution triggers. And also ensure that you include below attributes in testng.xml
<suite name="TestSuite" thread-count="2" parallel="methods" >
Thread-count - number of instances which you wish to open
Parllel - Indicates that the run should be parllel
In this run, there will be 2 browsers invoked at same time and two test cases(duplicated) will be executed in each browser. It cannot execute in two different tabs, it will be in two different windows
And also please note that it may not be accurate and there may be a difference of fraction of seconds due to network latency and machine performance
I have done automation using selenium IDE for my web application. But I couldn't get the pass/fail status report. Please show me how to get the status report in selenium IDE.
You can check this link:
https://www.quora.com/Does-selenium-IDE-support-pass-and-fail-status-reports
It has the Youtube link which answers your question.
1st thing selenium IDE can show you some summery like how many tests
passed and failed but it cannot generate enhanced reports.
for example: selenium IDE have set of test cases in its lift side panel and and they are enclosed in test suites most probably, and each test case have test steps as rows in selenium IDE body.
So while execution if a test step passes then its indicates in green color and red if fails, and if a step fails then test case in left panel indicates in red color and at bottom of the left panel you will see a number in green color which indicates passed tests and a number in red color which indicates failed ones
this is the only way it shows the summery of the execution, but you can't generate full length reports because simply selenium IDE is not meant for that purpose
most of the times people use selenium IDE for simple automation tasks where they don't expect any reporting like things, if there is a complex or more requirements of automation one has to move from selenium IDE to WebDriver
I use TDD quite a lot, and I was wondering if there is a way to show the Run Tool window only when there are failed tests?
Or to be more generic, for any run configuration, I would like the Run Tool window to be shown only when something goes wrong. Otherwise I would prefer the little non-obtrusive green pop-up to appear. Like when you run a lot of tests and you minimize the Run Tool by clicking on the "down arrow" in its top-right corner. When the tests are done, a little green pop-up appears over the minimized window.
I would also compromise for an answer that tells me how to keep the Run Tool always minimized, and only see little pop-ups, regardless if they are green or red.
This is probably not exactly the answer you wanted but if you look in the RunConfiguration (Run->Edit Configurations -> JUnit) for your test run you should see a checkbox called 'Activate tool window'. If that box is ticked then the Run Tool window will pop open even if its minimised. When it's not ticked then the Run Tool window will stay minimised.
So, for any individual existing test run you can change the check box value to prevent the tool window appearing. If you're doing TDD that could mean you have many configurations for specific test cases / suites etc, which you would need to change individually.
In the longer term, you probably want to avoid future run configurations popping up the test. You can do that through the Defaults -> JUnit section in the RunConfigurations window.
Also, in the tab "Logs" you can check the option "Show console when a message is printed to standard error stream"
When this option is checked the window is opened automatically if some test fails.
I have test with 3 test methods.
In output console I can see only data from the last run test method. Previous tests outputs are cleared.
Is it possible to see outputs of all test methods?
Thanks.
There is a tree of tests displayed on the left of the panel, click on the root to see the output of all the tests or click on the specific tests to see their output.