This is the backlog for Qt Metrics 2 site currently under development.
In case of proposals or improvement ideas please contact Juha Sippola (report builder, database) or Tony Sarajärvi (parser).
1. Data reliability and completeness (database and parser)
Status |
Priority |
Item
|
in progress |
*** |
Get the actual testset parent (not the Qt5 where it was run)
|
idle |
*** |
Change build_number (int) to build_key (string) for the new-CI
|
idle |
*** |
Get testfunctions from xml
|
idle |
*** |
Get testrows from xml
|
idle |
** |
Database indexing (for performance)
|
idle |
** |
OS grouping (currently platform.os has quite many values, should we group e.g. all windows platforms into one on home page)
|
idle |
** |
Change testset_run.testcases_xxx to total_xxx (terminology change)
|
2. Pages and views
Status |
Priority |
Item
|
in progress |
*** |
Home page modifications (enable buttons)
|
idle |
** |
Summary graph
|
idle |
*** |
Overview page
|
idle |
*** |
Project page
|
idle |
*** |
Project page: Link to log file
|
idle |
** |
Project page: Way to expand the range of builds, include dates to listed builds
|
idle |
*** |
Platform page
|
idle |
*** |
Platform page: Link to log file
|
idle |
** |
Platform page: OS grouping
|
idle |
** |
Platform page: Configuration flag identification
|
idle |
* |
Platform page: Identification of configurations where insignificant or force success could be removed
|
idle |
* |
Platform page: Filtering mechanism
|
idle |
* |
Branch page
|
done |
*** |
Top failing testsets page
|
done |
*** |
Top flaky testsets page
|
in progress |
*** |
Testset page
|
idle |
*** |
Testset page: Link to log file
|
idle |
*** |
Testset page: Testset flag identification
|
idle |
** |
Testset page: Testset run times
|
idle |
* |
Testset page: Filtering mechanism
|
idle |
* |
Testset page: Identification of testsets where insignificant could be removed
|
idle |
*** |
Testfunction page/information
|
idle |
*** |
Testfunction page/information: Testfunction flag identification
|
idle |
** |
Testfunction page/information: Identification of testfunctions where blacklisting could be removed
|
idle |
** |
Testfunction page/information: Link to xml file
|
idle |
* |
Testfunction page/information: Find skipped testfunctions
|
idle |
*** |
Testrow page/information
|
idle |
** |
Top failed testfunctions page
|
3. Graphs
Status |
Priority |
Item
|
idle |
** |
Build phases by configuration (like in the old metrics page)
|
idle |
* |
Build phases by configuration: Tick box to select if idle times are included or not in the Build phases graph
|
idle |
* |
Build phases by configuration: Configuration result to the Build phases graph (e.g. to conf title)
|
idle |
* |
Build phases by configuration: Add tooltips into Build phases graph (e.g phase name and value)
|
idle |
* |
Visualize CI performance via testset execution time (to visualize sequential and parallel runs)
|
idle |
* |
Visualize CI performance via the trend of phase duration (one, or several if feasible) across the last 20 builds in selected Project Configuration
|
idle |
* |
Improvement progress trend graphs, e.g. on build success rates, build execution times, Configuration and Autotest force success and insignificant flag removals.
|
4. Other features
Status |
Priority |
Item
|
idle |
*** |
Web security
|
idle |
** |
Utilise Ajax for better user experience
|
idle |
* |
Progress bar when loading page or data
|
idle |
* |
Link(s) to other related Qt Metrics
|
idle |
* |
Associate gerrit change ids with builds
|
idle |
* |
Include the bug id’s for test cases. This requires first a database or other solution where to get the data.
|
idle |
* |
Log file parsing helper (a way to find things in the last n logs)
|
idle |
* |
Register to receive error reports to a certain module (plus unregister)
|
idle |
* |
Report generator to create a detailed text & graph report from a view. This would be applicable for such data that takes long time to extract and format.
|
idle |
* |
Data export to excel/pdf from a view
|
idle |
* |
Identify which CI build machines failed most often and which CI builds take the longest time to execute
|
idle |
* |
Add Google Analytics to get information on the portal usage
|
idle |
* |
Support for https
|
5. Documentation
Status |
Priority |
Item
|
idle |
** |
Implementation solution description
|
in progress |
** |
Database design
|
in progress |
* |
Class documentation
|