Qt wiki will be updated on October 12th 2023 starting at 11:30 AM (EEST) and the maintenance will last around 2-3 hours. During the maintenance the site will be unavailable.
Qt Creator ManualTests DebuggerGdb: Difference between revisions
(Improve breakpoint test) |
m (Avoid medical terms) |
||
(30 intermediate revisions by 4 users not shown) | |||
Line 1: | Line 1: | ||
[[Category:Tools::QtCreator::QualityAssurance]] | [[Category:Tools::QtCreator::QualityAssurance]] | ||
tests/ | For the following tests, you will need to build projects on Qt using gcc/MinGW and debug them using gdb. You can get such a build of Qt from the official [https://download.qt.io/official_releases/online_installers/ Online Installer]. | ||
{| class="wikitable" | {| class="wikitable" | ||
|+ | |+ Tests using ''tests/manual/debugger/simple/simple.pro'' from Qt Creator's source repository | ||
! Test | ! Test | ||
! Result | ! Result | ||
! Annotation | ! Annotation | ||
|+ | |+ | ||
| Set breakpoint, press F5 to build and run debugger, verify that program stops at a breakpoint that you set: | | Set breakpoint, press F5 to build and run debugger, verify that program stops at a breakpoint that you set: | ||
Line 21: | Line 17: | ||
| | | | ||
|+ | |+ | ||
| "Step into" a couple of times. Can you step into Qt source code ( | | "Step into" a couple of times. Can you step into Qt source code (*.cpp file under QTDIR. You might need to configure source paths mapping under "Edit" -> "Preferences..." -> "Debugger" -> "General" -> "Add Qt sources...")? | ||
(Mac: switch on 'Use Debug Versions of Frameworks' in run configuration. You need Qt sources.) | ('''Mac''': switch on 'Use Debug Versions of Frameworks' in run configuration. You need Qt sources.) | ||
| | | | ||
| | | | ||
|+ | |+ | ||
| Test debugging helpers/python gdb: Do classes like QImage or std::string show beautiful information instead of the raw structure? | | Test debugging helpers/python gdb: Do classes like QImage or std::string show beautiful information instead of the raw structure? | ||
| | | automated | ||
| | | | ||
|+ | |+ | ||
| Step through some test* functions and check whether the displayed data looks | | Step through some (not all) test* functions and check whether the displayed data looks correct | ||
| | | | ||
| The code contains comments with the expected displayed data. These are meant for semi-automatic runs and might differ from what you see. Use your own judgement what's correct and what's not. | |||
|+ | |+ | ||
| Comment out the return statement | | Comment out the return statement inside the following functions one by one. Check whether you'll end up with a proper stack trace & locals display. | ||
* | * testNullPointerDeref() | ||
* | * testNullReference() | ||
* testEndlessLoop(); (break manually) | * testEndlessLoop(); (break manually) | ||
* testEndlessRecursion(); | * testEndlessRecursion(); | ||
* testUncaughtException(); | * testUncaughtException(); (not on Windows) | ||
| | | | ||
| | | | ||
|+ | |+ | ||
| | | Test a breakpoint in a QThread: | ||
# Uncomment the call to qthread::testQThread() | |||
# Place a breakpoint in qthread::Thread::run() | |||
# Run this in the debugger | |||
# Make sure that: | |||
#* the breakpoint receives the right number of hits | |||
#* "Locals and Expressions" and "Stack" views show reasonable data, including the object names of the threads | |||
| | | | ||
| | | | ||
|+ | |+ | ||
| | | Switch on temporarily 'Operate by Instruction' (small icon above the stack trace) and check whether you see disassembler output and can step by instruction | ||
| | | | ||
|} | |||
{| class="wikitable" | |||
|+ Tests using ''tests/manual/debugger/cli-io/cli-io.pro'' from Qt Creator's source repository | |||
! Test | |||
! Result | |||
! Annotation | |||
|+ | |||
| Check I/O (qDebug, std::cout, std::cerr), on Win for both Debug and Release. | |||
| | | | ||
|stderr/stdout handling on Windows: | |||
* An application needs to be built with 'console' for stderr/stdout to appear (use Creator's "Run in terminal" setting) | |||
* Creator itself is built with 'console' in debug mode only. | |||
* qDebug() prints to stderr for ‘console’ apps, else to the Windows debugger log, which can be shown with the DbgView utility | |||
|+ | |+ | ||
| Check "Run in Terminal". Use Terminal for input. (Debbuging might not work on Ubuntu) | | Check "Run in Terminal". Use Terminal for input. (Debbuging might not work on Ubuntu) | ||
| | | | ||
| | |||
|+ | |||
| Create new project. Can you build, run and debug it? | |||
| automated | |||
| | | | ||
|+ | |+ | ||
Line 58: | Line 77: | ||
| automated | | automated | ||
| | | | ||
|} | |||
{| class="wikitable" | |||
|+ Tests using ''tests/manual/debugger/gui/gui.pro'' from Qt Creator's source repository | |||
! Test | |||
! Result | |||
! Annotation | |||
|+ | |+ | ||
| Linux | | | ||
When testing on Linux or Mac: | |||
# Run the project outside Creator. | |||
# Click the button "Crash".<br/>It should write a core file to the working directory. Depending on the operating system, you might have to set "ulimit –c unlimited" and/or disable OS-specific crash-reporting mechanisms. | |||
# Attach Creator to the core file.<br/>Verify that you see a stack trace, variable values and code markers just as if you had run the application in the debugger from the beginning. | |||
| | |||
| | |||
|- | |||
| | |||
# Start the project from outside Creator, e.g. from the command line. | |||
# Attach Creator to the running process.<br/>Verify that you see a stack trace, variable values and code markers just as if you had run the application in the debugger from the beginning. You should also be able to pause/continue the execution. | |||
| | |||
| | |||
|- | |||
| Test unusual situations: Kill the running debugged program 'externally' with a signal that is neither SIGSTOP nor SIGKILL. Qt Creator should end up showing a backtrace. | |||
| | | | ||
| | | | ||
|+ | |+ | ||
| | | Kill the stopped debugged program 'externally'. Nothing should happen immediately, on next continue or step Qt Creator should end up showing a backtrace. | ||
| | | | ||
| | | | ||
Line 71: | Line 111: | ||
in creator/tests/manual/fakevim on a Linux machine and connect to it | in creator/tests/manual/fakevim on a Linux machine and connect to it | ||
| | | | ||
|} | |||
{| class="wikitable" style="width: 80%" | |||
|+ Test run as root from inside QC - any simple application (Linux, macOS) | |||
! Test | |||
! Result | |||
! Annotation | |||
|+ | |||
| | |||
Run the project without checking "Run as root user" on the run settings page. | |||
# Verify application is starting and can be used as expected. | |||
| | |||
| | |||
|- | |||
| | |||
Debug the project without checking "Run as root user" on the run settings page. | |||
# Verify application and debugger are starting correctly. | |||
# Verify you can interrupt the application and hit a breakpoint. Check some locals whether they contain sane data. | |||
| | |||
| | |||
|- | |||
| | |||
Run the project with checking "Run as root user" on the run settings page. | |||
# Verify application is starting correctly. | |||
# Use the OS' means to verify that the application is actually running for user "root". | |||
# Close the application and start it again immediately. Creator should not ask for entering credentials again. | |||
# Run "sudo -K" to ensure credentials are reset. | |||
# Re-run and check whether credentials are requested again. | |||
| | |||
| | |||
|- | |||
| | | | ||
Debug the project with checking "Run as root user" on the run settings page. | |||
# Verify application and debugger are starting correctly.<br/>gdb running as "root" user is acceptable. | |||
# Use the OS' means to verify that the application is actually running for user "root". | |||
# Verify you can interrupt the application and hit a breakpoint. Check some locals whether they contain sane data. | |||
# Close the debugging session and start it again immediately. Creator should not ask for entering credentials again. | |||
# Run "sudo -K" to ensure credentials are reset. | |||
# Re-run and check whether credentials are requested again. | |||
# Re-do verifications above. | |||
| | |||
| | |||
|- | |||
| | | | ||
Is entering invalid credentials handled correctly? | |||
| | | | ||
| | |||
|} | |} | ||
Latest revision as of 10:48, 30 June 2023
For the following tests, you will need to build projects on Qt using gcc/MinGW and debug them using gdb. You can get such a build of Qt from the official Online Installer.
Test | Result | Annotation |
---|---|---|
Set breakpoint, press F5 to build and run debugger, verify that program stops at a breakpoint that you set:
|
||
"Step into" a couple of times. Can you step into Qt source code (*.cpp file under QTDIR. You might need to configure source paths mapping under "Edit" -> "Preferences..." -> "Debugger" -> "General" -> "Add Qt sources...")?
(Mac: switch on 'Use Debug Versions of Frameworks' in run configuration. You need Qt sources.) |
||
Test debugging helpers/python gdb: Do classes like QImage or std::string show beautiful information instead of the raw structure? | automated | |
Step through some (not all) test* functions and check whether the displayed data looks correct | The code contains comments with the expected displayed data. These are meant for semi-automatic runs and might differ from what you see. Use your own judgement what's correct and what's not. | |
Comment out the return statement inside the following functions one by one. Check whether you'll end up with a proper stack trace & locals display.
|
||
Test a breakpoint in a QThread:
|
||
Switch on temporarily 'Operate by Instruction' (small icon above the stack trace) and check whether you see disassembler output and can step by instruction |
Test | Result | Annotation |
---|---|---|
Check I/O (qDebug, std::cout, std::cerr), on Win for both Debug and Release. | stderr/stdout handling on Windows:
|
|
Check "Run in Terminal". Use Terminal for input. (Debbuging might not work on Ubuntu) | ||
Create new project. Can you build, run and debug it? | automated | |
Check nothing bad happens on a simple int main() {} program with no breakpoints set | automated |
Test | Result | Annotation |
---|---|---|
When testing on Linux or Mac:
|
||
|
||
Test unusual situations: Kill the running debugged program 'externally' with a signal that is neither SIGSTOP nor SIGKILL. Qt Creator should end up showing a backtrace. | ||
Kill the stopped debugged program 'externally'. Nothing should happen immediately, on next continue or step Qt Creator should end up showing a backtrace. | ||
Try remote debugging: start a gdbserver using e.g.
gdbserver localhost:1234 ./fakevim
in creator/tests/manual/fakevim on a Linux machine and connect to it |
Test | Result | Annotation |
---|---|---|
Run the project without checking "Run as root user" on the run settings page.
|
||
Debug the project without checking "Run as root user" on the run settings page.
|
||
Run the project with checking "Run as root user" on the run settings page.
|
||
Debug the project with checking "Run as root user" on the run settings page.
|
||
Is entering invalid credentials handled correctly? |