Qt5ForAndroidAutotests

h1. Qt 5 for Android project - Autotests

The following results are from a run of Qt 5 for Android on July 31st, 2013 based on a recent version of the dev branch in http://codereview.qt.io. Only test cases with failures are listed. The tests were run on a physical Nexus 4.

The following patches were applied: https://codereview.qt.io/#change,62497 https://codereview.qt.io/#change,62455

Please note that a few tests crashed and some did not build properly. These are missing from the report.

Total statistics

17262 pass 203 fail

tst_QRand

2 pass 1 fail

Failures: testqrand (): fail tst_qrand.cpp(68): 'generatesSameSequence' returned FALSE. ()

tst_QDir

185 pass 31 fail

Failures: entryList (nofilter): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 4
Expected (expected.count()): 7

entryList (QDir::Files): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 1
Expected (expected.count()): 3

entryList (QDir::Dirs): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 3
Expected (expected.count()): 4

entryList (QDir::Dirs | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 1
Expected (expected.count()): 2

entryList (QDir::AllEntries | QDir::NoSymLinks): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 4
Expected (expected.count()): 5

entryList (QDir::AllEntries | QDir::NoSymLinks | QDir::NoDotAndDotDot): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 2
Expected (expected.count()): 3

entryList (QDir::System): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 0
Expected (expected.count()): 1

entryList (QDir::AllEntries | QDir::Hidden | QDir::System): fail tst_qdir.cpp(773): Compared values are not the same

Actual (actual[i]) : directory
Expected (expected[i]): brokenlink.lnk

entryList (QDir::AllEntries | QDir::Writable): fail tst_qdir.cpp(773): Compared values are not the same

Actual (actual[i]) : ..
Expected (expected[i]): .

entryList (Namefilters link*): fail tst_qdir.cpp(775): Compared values are not the same

Actual (actual.count()) : 0
Expected (expected.count()): 2

entryList (Sorting QDir::Name | QDir::Reversed): fail tst_qdir.cpp(773): Compared values are not the same

Actual (actual[i]) : file
Expected (expected[i]): writable

mkdir (data0): fail tst_qdir.cpp(302): 'dir.mkpath(path)' returned FALSE. () mkdir (data1): fail tst_qdir.cpp(304): 'dir.mkdir(path)' returned FALSE. () rmdir (data0): fail tst_qdir.cpp(355): 'dir.rmpath(path)' returned FALSE. () rmdir (data1): fail tst_qdir.cpp(357): 'dir.rmdir(path)' returned FALSE. () equalityOperator (QTBUG-20495-root): fail tst_qdir.cpp(1942): Compared values are not the same

Actual ((dir1 == dir2)): 0
Expected (expected) : 1

cdBelowRoot (): fail tst_qdir.cpp(2008): 'root.cd(CD_INTO)' returned FALSE. () (and other identical test failures)

tst_QDirIterator

16 pass 7 fail

Failures: iterateRelativeDirectory (no flags): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '4'
Expected (sortedEntries) size: '7'

iterateRelativeDirectory (NoDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '3'
Expected (sortedEntries) size: '6'

iterateRelativeDirectory (NoDotAndDotDot): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '2'
Expected (sortedEntries) size: '5'

iterateRelativeDirectory (QDir::Subdirectories | QDir::FollowSymlinks): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '7'
Expected (sortedEntries) size: '10'

iterateRelativeDirectory (QDir::Subdirectories / QDir::Files): fail tst_qdiriterator.cpp(377): Compared lists have different sizes.

Actual (list) size: '2'
Expected (sortedEntries) size: '4'

(and other identical test failures)

tst_QFileInfo

150 pass 3 fail

Failures: fileTimes (simple): fail tst_qfileinfo.cpp(1085): 'fileInfo.lastRead() > beforeRead' returned FALSE. () (and other identical test failures)

tst_QFileSystemWatcher

19 pass 2 fail

Failures: addPaths (): fail tst_qfilesystemwatcher.cpp(373): Compared lists have different sizes.

Actual (watcher.addPaths(paths)) size: '1'
Expected (QStringList()) size: '0'

removePaths (): fail tst_qfilesystemwatcher.cpp(387): Compared lists have different sizes.

Actual (watcher.addPaths(paths)) size: '1'
Expected (QStringList()) size: '0'

tst_QResourceEngine

0 pass 2 fail

Failures: initTestCase (): fail tst_qresourceengine.cpp(67): 'QResource::registerResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. () cleanupTestCase (): fail tst_qresourceengine.cpp(74): 'QResource::unregisterResource(QFINDTESTDATA ("runtime_resource.rcc"))' returned FALSE. ()

tst_QMetaType

580 pass 33 fail

Failures: flagsBinaryCompatibility5_0 (QFont): fail tst_qmetatype.cpp(953): Compared values are not the same

Actual (quint32(QMetaType::typeFlags(id))): 7
Expected (flags) : 0

flagsBinaryCompatibility5_0 (QColor): fail tst_qmetatype.cpp(953): Compared values are not the same

Actual (quint32(QMetaType::typeFlags(id))): 3
Expected (flags) : 0

saveAndLoadBuiltin (QFont): fail tst_qmetatype.cpp(1657): Compared values are not the same

Actual (QMetaType::save(stream, type, value)): 1
Expected (isStreamable) : 0

(and other identical test failures)

tst_QTranslator

10 pass 1 fail

Failures: dependencies (): fail tst_qtranslator.cpp(250): '!tor.isEmpty()' returned FALSE. ()

tst_QUuid

1 pass 1 fail

Failures: initTestCase (): fail ../tst_quuid.cpp(108): 'QDir::setCurrent(testdata_dir)' returned FALSE. (Could not chdir to )

tst_QThread

10 pass 1 fail

Failures: terminate (): fail Unknown file(0): Received a fatal error.

tst_QThread

10 pass 1 fail

Failures: terminate (): fail Unknown file(0): Received a fatal error.

tst_QThread

10 pass 1 fail

Failures: terminate (): fail Unknown file(0): Received a fatal error.

tst_QImageWriter

81 pass 14 fail

Failures: writeImage (BMP: colorful): fail tst_qimagewriter.cpp(220): 'writer.write(image)' returned FALSE. () saveWithNoFormat (bmp): fail tst_qimagewriter.cpp(484): 'writer.write(niceImage)' returned FALSE. (Device not writable) (and other identical test failures)

tst_QEventDispatcher

3 pass 2 fail

Failures: registerTimer (): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(165): Compared values are not the same

Actual (receivedEventType) : –1
Expected (int(QEvent::Timer)): 1

sendPostedEvents (WaitForMoreEvents): fail ../../../corelib/kernel/qeventdispatcher/tst_qeventdispatcher.cpp(208): Compared values are not the same

Actual (receivedEventType): 1
Expected (int(QEvent::User)): 1000

tst_QTouchEvent

4 pass 8 fail

Failures: touchDisabledByDefault (): fail tst_qtouchevent.cpp(303): '!touchEvent.isAccepted()' returned FALSE. () touchEventAcceptedByDefault (): fail tst_qtouchevent.cpp(326): 'res' returned FALSE. () touchUpdateAndEndNeverPropagate (): fail tst_qtouchevent.cpp(520): 'res' returned FALSE. () basicRawEventTranslation (): fail tst_qtouchevent.cpp(635): 'touchWidget.seenTouchBegin' returned FALSE. () multiPointRawEventTranslationOnTouchScreen (): fail tst_qtouchevent.cpp(775): 'leftWidget.seenTouchBegin' returned FALSE. () multiPointRawEventTranslationOnTouchPad (): fail tst_qtouchevent.cpp(1002): 'leftWidget.seenTouchBegin' returned FALSE. () deleteInEventHandler (): fail tst_qtouchevent.cpp(1317): 'res && !touchUpdateEvent.isAccepted() && !child2' returned FALSE. () deleteInRawEventTranslation (): fail tst_qtouchevent.cpp(1391): 'pl.isNull() && !pc.isNull() && !pr.isNull()' returned FALSE. ()

tst_QCssParser

1 pass 1 fail

Failures: scanner (): fail Unknown file(0): Received a fatal error.

tst_QFont

11 pass 5 fail

Failures: defaultFamily (serif): fail tst_qfont.cpp(679): 'db.hasFamily(familyForHint)' returned FALSE. () (and other identical test failures)

tst_QFontCache

2 pass 1 fail

Failures: clear (): fail tst_qfontcache.cpp(107): 'db.hasFamily(familyForHint)' returned FALSE. ()

tst_QFontDatabase

1 pass 1 fail

Failures: initTestCase (): fail tst_qfontdatabase.cpp(97): '!m_testFont.isEmpty()' returned FALSE. ()

tst_QFontMetrics

12 pass 2 fail

Failures: elidedMultiLength (): fail tst_qfontmetrics.cpp(254): Compared values are not the same

Actual (fm.elidedText(text1,Qt::ElideRight, width_small + 1)):
Expected (text1_el) : s…

(and other identical test failures)

tst_QGlyphRun

1 pass 1 fail

Failures: initTestCase (): fail tst_qglyphrun.cpp(98): 'm_testFontId >= 0' returned FALSE. ()

tst_QRawFont

1257 pass 1 fail

Failures: advances (Full hinting): fail tst_qrawfont.cpp(325): 'qFuzzyCompare(qRound(advances.at(i).x()), 8.0)' returned FALSE. ()

tst_QStaticText

25 pass 2 fail

Failures: rotatedPainter (): fail tst_qstatictext.cpp(423): Compared values are not the same transformationChanged (): fail tst_qstatictext.cpp(580): Compared values are not the same

tst_QTextLayout

121 pass 1 fail

Failures: columnWrapWithTabs (): fail tst_qtextlayout.cpp(1820): 'line.textLength() < text.length()' returned FALSE. ()

tst_QTextScriptEngine

8 pass 1 fail

Failures: thaiWithZWJ (): fail tst_qtextscriptengine.cpp(1238): Compared values are not the same

Actual (logClusters[17]): 0
Expected (ushort(1)) : 1

tst_QFtp

1 pass 1 fail

Failures: initTestCase (): fail tst_qftp.cpp(212): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QHttpNetworkConnection

1 pass 1 fail

Failures: initTestCase (): fail tst_qhttpnetworkconnection.cpp(125): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QNetworkCookieJar

113 pass 2 fail

Failures: rfc6265 (): fail tst_qnetworkcookiejar.cpp(473): 'file.open(QFile::ReadOnly | QFile::Text)' returned FALSE. () rfc6265 (): fail Unknown file(0): Received a fatal error.

tst_QNetworkSession

1 pass 1 fail

Failures: initTestCase (): fail tst_qnetworksession.cpp(128): '!lackeyDir.isEmpty()' returned FALSE. (Couldn't find lackey dir starting from /data/data/org.qtproject.qt5.android.tests/app_files.)

tst_QDnsLookup

18 pass 62 fail

Failures: lookup (normal:a-notfound): fail tst_qdnslookup.cpp(211): 'int(lookup.error()) == error' returned FALSE. (Not yet supported on Android) lookupReuse (normal): fail tst_qdnslookup.cpp(306): Compared values are not the same

Actual (int(lookup.error())) : 1
Expected (int(QDnsLookup::NoError)): 0

lookupAbortRetry (normal): fail tst_qdnslookup.cpp(344): Compared values are not the same

Actual (int(lookup.error())) : 1
Expected (int(QDnsLookup::NoError)): 0

(and other identical test failures)

tst_QHostInfo

1 pass 1 fail

Failures: initTestCase (): fail tst_qhostinfo.cpp(191): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_PlatformSocketEngine

1 pass 1 fail

Failures: initTestCase (): fail tst_platformsocketengine.cpp(110): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QHttpSocketEngine

1 pass 1 fail

Failures: initTestCase (): fail tst_qhttpsocketengine.cpp(152): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QLocalSocket

52 pass 5 fail

Failures: fullPath (): fail ../tst_qlocalsocket.cpp(645): 'server.listen(serverName)' returned FALSE. (QLocalServer::listen: Name error) processConnection (1 client): fail ../tst_qlocalsocket.cpp(839): 'QFile::exists(socketProcess)' returned FALSE. () (and other identical test failures)

tst_QSocks5SocketEngine

1 pass 1 fail

Failures: initTestCase (): fail tst_qsocks5socketengine.cpp(181): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket

1 pass 1 fail

Failures: initTestCase (): fail tst_qsslsocket.cpp(272): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket_onDemandCertificates_member

1 pass 1 fail

Failures: initTestCase (): fail tst_qsslsocket_onDemandCertificates_member.cpp(128): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()

tst_QSslSocket_onDemandCertificates_static

1 pass 1 fail

Failures: initTestCase (): fail tst_qsslsocket_onDemandCertificates_static.cpp(124): 'QtNetworkSettings::verifyTestNetworkSettings()' returned FALSE. ()