Hello everyone I would like to ask for your assistance if there's a way I could create an HTML/GUI Report upon running "dbt test" command. Your response is highly appreciated.
This is the result I got upon running dbt test
There are some 3rd party libraries that will generate reports like the one you're looking for. One you can try is called Elementary Data (https://www.elementary-data.com/). When you run DBT tasks, it creates a schema with all of the stats on model execution timings, test results, etc. It then has a command to generate an HTML page using those results to publish some simple graphs and aggregate test results.
Related
I have manual test plan in Azure DevOps with tree of suites that correspond to different functions in my app. Let's say it looks like this:
Now, I need to have one place where I can review tests results from whole test plan ran for particular build. Like acceptance tests.
There's no way to run multiple suites in one run, I guess. Didn't find such possibility, though. Tests ran suite by suite produce multiple testruns, which is understandable.
What I want to achieve is one link to all test results for specific build which I can provide further to PM.
I have been searching for a while now and am surprised that I can't find any solutions out there for test result storage with grouping and searching capabilities.
I'd like a service or self hosted solution that supports:
storing test results in xunit/junit organized by keyword. In other words, I want to keep all my "test process A" test results together and all my "test process B" results together. I want to store failure traces and overall pass/fail at a minimum
get last run results for keyword: get the last "auth" test results with failure details
get run history results by keyword in some format
search of some sort on test results
I happen to be have:
Cypress tests
typescript/mocha tests without cypress
custom test framework tests that will need custom reporters
but I am fine with any test results solution that supports a generic input like xunit.
I am definitely open to suggestions that use any other storage system that can accomplish this even if it isn't strictly a test results tool.
We need to export the latest run with every step and its attachments in AzureDevOps. It is a 300 Test Cases run/execution report that needs to be approved, as we have many use cases, it is not plausible to go one run by one run and download every attachment step and print it by hand.
I tried exporting TestPlans, the export from Test Plan does not apply in this case as it does not care about the runs steps and its attachments. I do not see a solution with the new AzureDevOps run Page,
Would like to know if I am missing any configuration option or if there is an API or even product to export the data. e.g. Example one of many Runs to save in Report Many
I saw other similar questions but still missing how to export runs reports with its steps and attachment. Image below,
Example of one of the 300 runs to export
Many Thanks
UPDATE: As I do not see any an out of the box solution I am trying to get the information from this API ResultsAPI but I am not able yet to get the ActionResultModel that includes the stepIdentifier. Also problems downloading the attachments.
In this AzureDevOps version there is no way to export the run steps result. Also the results API is not retrieving the step result information, I did some test with the API and it is not possible to get the testActionResultModel in the response. The maximum that you can get is the iterations list, but there is no link between the iterations and the steps.
https://learn.microsoft.com/en-us/rest/api/azure/devops/test/action%20results/list?view=azure-devops-rest-5.1#testactionresultmodel
Thank you
You have a try with the export option in Test Plans. First you need to create a test plan and add all your manual test cases using query to this test plan.
You can follow the detailed steps of Creating test plans and test suites.
Go to Test plans under Test Plans of your project. Then click the 3 dots beside your test plan and selet Export
Then check the options you to export.
Then you will get an export of all the manual test cases included in this test plan with their steps and attachments.
Hope above helps!
Our cucmber-overview report looks like below.
We want to add a new column to this report with name "Author" of the script.
We are using selenium,Java and gherkin for automation.
Can anyone help ?
Thank you.
I'm not sure if there's an easy way to add this data during the test execution itself, but as the report is an HTML file, then you can surely manipulate it after the fact.
You'd probably need to save your additional information during the test execution in a separate file or database. Then, in a separate process after the test execution completes and the original report is generated, you should read this data and add it to the HTML file using jsoup or something similar.
Where can i save my testNG reports for analysis later.
My regression suite will be running daily and I want to store the reports for anaysis and comparitive study later.
What can i use for the same?
Allure, ReportPortal or maybe some other tools could help you.
There is no such repository. You can go ahead and build a customized org.testng.IReporter which persists the test results to a database which you can fetch and run your analysis.
As suggested you can go database..
Generally i used custom HTML reports for suite and links to Tests HTML reports. I will create dir with data and time stamp for every run and move to shared location to keep and share.