Discussion:
Current RHEL and Fedora testresults
Add Reply
Mark Wielaard
2017-05-17 15:16:43 UTC
Reply
Permalink
Raw Message
Hi,

Given that we are switching to release mode I ran valgrind (svn r16393,
VEX svn r3374) through some RHEL and Fedora builders to see how the
regtest results are looking. For the RHEL builds I don't have public
logs, but I will look at them and see what the failures are really
about. For the Fedora builds there are public logs in koji which include
the vgtest diffs.

= RHEL (gcc 4.8.5, binutils 2.25.1, glibc 2.17, gdb 7.6.1,
kernel 2.6.32/3.10.0)

ppc:
== 623 tests, 7 stderr failures, 0 stdout failures, 0 stderrB failures,
1 stdoutB failure, 2 post failures ==
gdbserver_tests/hgtls (stdoutB)
memcheck/tests/linux/stack_changes (stderr)
memcheck/tests/origin2-not-quite (stderr)
memcheck/tests/test-plo-no (stderr)
massif/tests/big-alloc (post)
massif/tests/deep-D (post)
none/tests/rlimit64_nofile (stderr)
helgrind/tests/tc22_exit_w_lock (stderr)
drd/tests/annotate_trace_memory (stderr)
drd/tests/annotate_trace_memory_xml (stderr)

x86_64:
== 762 tests, 2 stderr failures, 0 stdout failures, 0 stderrB failures, 1 stdoutB failure, 0 post failures ==
gdbserver_tests/hgtls (stdoutB)
memcheck/tests/amd64/sh-mem-vec256-plo-no (stderr)
memcheck/tests/amd64/sh-mem-vec256-plo-yes (stderr)

pp64le:
== 618 tests, 1 stderr failure, 1 stdout failure, 0 stderrB failures, 1 stdoutB failure, 1 post failure ==
gdbserver_tests/hgtls (stdoutB)
memcheck/tests/bug340392 (stderr)
memcheck/tests/vcpu_fnfns (stdout)
massif/tests/deep-D (post)

aarch64:
== 602 tests, 24 stderr failures, 5 stdout failures, 0 stderrB failures, 1 stdoutB failure, 0 post failures ==
gdbserver_tests/hgtls (stdoutB)
memcheck/tests/arm64-linux/scalar (stderr)
memcheck/tests/dw4 (stderr)
memcheck/tests/leak-segv-jmp (stderr)
memcheck/tests/linux/getregset (stdout)
memcheck/tests/linux/getregset (stderr)
memcheck/tests/supp_unknown (stderr)
memcheck/tests/varinfo1 (stderr)
memcheck/tests/varinfo2 (stderr)
memcheck/tests/varinfo3 (stderr)
memcheck/tests/varinfo4 (stderr)
memcheck/tests/varinfo5 (stderr)
memcheck/tests/varinfo6 (stderr)
memcheck/tests/varinforestrict (stderr)
helgrind/tests/hg05_race2 (stderr)
helgrind/tests/tc20_verifywrap (stderr)
drd/tests/pth_cancel_locked (stderr)
drd/tests/std_thread2 (stderr)
drd/tests/tc04_free_lock (stderr)
drd/tests/tc09_bad_unlock (stderr)
exp-sgcheck/tests/bad_percentify (stdout)
exp-sgcheck/tests/bad_percentify (stderr)
exp-sgcheck/tests/globalerr (stderr)
exp-sgcheck/tests/hackedbz2 (stdout)
exp-sgcheck/tests/hackedbz2 (stderr)
exp-sgcheck/tests/hsg (stdout)
exp-sgcheck/tests/hsg (stderr)
exp-sgcheck/tests/preen_invars (stdout)
exp-sgcheck/tests/preen_invars (stderr)
exp-sgcheck/tests/stackerr (stderr)

ppc64:
== 661 tests, 1 stderr failure, 1 stdout failure, 0 stderrB failures, 1 stdoutB failure, 1 post failure ==
gdbserver_tests/hgtls (stdoutB)
memcheck/tests/bug340392 (stderr)
memcheck/tests/vcpu_fnfns (stdout)
massif/tests/deep-D (post)

i386:
== 676 tests, 0 stderr failures, 0 stdout failures, 0 stderrB failures, 1 stdoutB failure, 0 post failures ==
gdbserver_tests/hgtls (stdoutB)

s390x:
== 716 tests, 5 stderr failures, 0 stdout failures, 0 stderrB failures, 1 stdoutB failure, 0 post failures ==
gdbserver_tests/hgtls (stdoutB)
memcheck/tests/memcmptest (stderr)
memcheck/tests/origin5-bz2 (stderr)
memcheck/tests/varinfo6 (stderr)
none/tests/process_vm_readv_writev (stderr)
helgrind/tests/bar_bad (stderr)


= Fedora (gcc 7.1.1, binutils 2.28, glibc 2.25.90, gdb 7.99.90, kernel 4.10.14)

These look worse than they actually are because the gdbserver tests all
seem to fail because of some gdb/python initialization issue:
Python runtime initialized with LC_CTYPE=C (a locale with default ASCII
encoding), which may cause Unicode compatibility problems. Using
C.UTF-8, C.utf8, or UTF-8 (if available) as alternative
Unicode-compatible locales is recommended.
https://bugzilla.redhat.com/show_bug.cgi?id=1434601

x86_64:
https://kojipkgs.fedoraproject.org//work/tasks/5472/19595472/build.log
== 762 tests, 7 stderr failures, 3 stdout failures, 15 stderrB failures, 0 stdoutB failures, 2 post failures ==
gdbserver_tests/hginfo (stderrB)
gdbserver_tests/mcblocklistsearch (stderrB)
gdbserver_tests/mcbreak (stderrB)
gdbserver_tests/mcclean_after_fork (stderrB)
gdbserver_tests/mcinfcallWSRU (stderrB)
gdbserver_tests/mcleak (stderrB)
gdbserver_tests/mcmain_pic (stderr)
gdbserver_tests/mcmain_pic (stderrB)
gdbserver_tests/mcvabits (stderrB)
gdbserver_tests/mssnapshot (stderrB)
gdbserver_tests/nlgone_abrt (stderrB)
gdbserver_tests/nlgone_exit (stderrB)
gdbserver_tests/nlgone_return (stderrB)
gdbserver_tests/nlpasssigalrm (stderrB)
gdbserver_tests/nlself_invalidate (stderrB)
gdbserver_tests/nlsigvgdb (stderrB)
memcheck/tests/amd64/insn_basic (stdout)
memcheck/tests/amd64/sh-mem-vec256-plo-no (stderr)
memcheck/tests/amd64/sh-mem-vec256-plo-yes (stderr)
memcheck/tests/leak_cpp_interior (stderr)
memcheck/tests/overlap (stderr)
massif/tests/new-cpp (post)
massif/tests/overloaded-new (post)
none/tests/amd64/avx-1 (stdout)
none/tests/amd64/insn_basic (stdout)
none/tests/rlimit_nofile (stderr)
exp-sgcheck/tests/stackerr (stderr)

pp64le:
https://kojipkgs.fedoraproject.org//work/tasks/5473/19595473/build.log
== 618 tests, 7 stderr failures, 1 stdout failure, 14 stderrB failures, 0 stdoutB failures, 3 post failures ==
gdbserver_tests/hginfo (stderrB)
gdbserver_tests/mcblocklistsearch (stderrB)
gdbserver_tests/mcbreak (stderrB)
gdbserver_tests/mcclean_after_fork (stderrB)
gdbserver_tests/mcinfcallWSRU (stderrB)
gdbserver_tests/mcleak (stderrB)
gdbserver_tests/mcmain_pic (stderr)
gdbserver_tests/mcmain_pic (stderrB)
gdbserver_tests/mcvabits (stderrB)
gdbserver_tests/mssnapshot (stderrB)
gdbserver_tests/nlgone_abrt (stderrB)
gdbserver_tests/nlgone_exit (stderrB)
gdbserver_tests/nlgone_return (stderrB)
gdbserver_tests/nlpasssigalrm (stderrB)
gdbserver_tests/nlsigvgdb (stderrB)
memcheck/tests/bug340392 (stderr)
memcheck/tests/leak_cpp_interior (stderr)
memcheck/tests/linux/rfcomm (stderr)
memcheck/tests/ppc64/power_ISA2_05 (stderr)
memcheck/tests/ppc64/power_ISA2_07 (stderr)
memcheck/tests/vcpu_fnfns (stdout)
massif/tests/deep-D (post)
massif/tests/new-cpp (post)
massif/tests/overloaded-new (post)
none/tests/rlimit_nofile (stderr)

aarch64:
https://kojipkgs.fedoraproject.org//work/tasks/5474/19595474/build.log
== 602 tests, 35 stderr failures, 5 stdout failures, 14 stderrB failures, 2 stdoutB failures, 2 post failures ==
gdbserver_tests/hginfo (stderrB)
gdbserver_tests/hgtls (stdoutB)
gdbserver_tests/mcblocklistsearch (stderrB)
gdbserver_tests/mcbreak (stderrB)
gdbserver_tests/mcclean_after_fork (stderrB)
gdbserver_tests/mcinfcallWSRU (stderrB)
gdbserver_tests/mcleak (stderrB)
gdbserver_tests/mcmain_pic (stderr)
gdbserver_tests/mcmain_pic (stderrB)
gdbserver_tests/mcvabits (stderrB)
gdbserver_tests/mssnapshot (stderrB)
gdbserver_tests/nlgone_abrt (stderr)
gdbserver_tests/nlgone_abrt (stdoutB)
gdbserver_tests/nlgone_abrt (stderrB)
gdbserver_tests/nlgone_exit (stderrB)
gdbserver_tests/nlgone_return (stderrB)
gdbserver_tests/nlpasssigalrm (stderrB)
gdbserver_tests/nlsigvgdb (stderrB)
memcheck/tests/arm64-linux/scalar (stderr)
memcheck/tests/badjump (stderr)
memcheck/tests/deep-backtrace (stderr)
memcheck/tests/dw4 (stderr)
memcheck/tests/leak-segv-jmp (stderr)
memcheck/tests/leak_cpp_interior (stderr)
memcheck/tests/linux/getregset (stdout)
memcheck/tests/linux/getregset (stderr)
memcheck/tests/supp_unknown (stderr)
memcheck/tests/varinfo1 (stderr)
memcheck/tests/varinfo2 (stderr)
memcheck/tests/varinfo3 (stderr)
memcheck/tests/varinfo4 (stderr)
memcheck/tests/varinfo5 (stderr)
memcheck/tests/varinfo6 (stderr)
memcheck/tests/varinforestrict (stderr)
massif/tests/new-cpp (post)
massif/tests/overloaded-new (post)
none/tests/async-sigs (stderr)
none/tests/linux/blockfault (stderr)
none/tests/linux/stack-overflow (stderr)
none/tests/rlimit_nofile (stderr)
helgrind/tests/hg05_race2 (stderr)
helgrind/tests/tc20_verifywrap (stderr)
helgrind/tests/tc22_exit_w_lock (stderr)
drd/tests/pth_cancel_locked (stderr)
drd/tests/std_thread2 (stderr)
drd/tests/tc04_free_lock (stderr)
drd/tests/tc09_bad_unlock (stderr)
drd/tests/tc22_exit_w_lock (stderr)
exp-sgcheck/tests/bad_percentify (stdout)
exp-sgcheck/tests/bad_percentify (stderr)
exp-sgcheck/tests/globalerr (stderr)
exp-sgcheck/tests/hackedbz2 (stdout)
exp-sgcheck/tests/hackedbz2 (stderr)
exp-sgcheck/tests/hsg (stdout)
exp-sgcheck/tests/hsg (stderr)
exp-sgcheck/tests/preen_invars (stdout)
exp-sgcheck/tests/preen_invars (stderr)
exp-sgcheck/tests/stackerr (stderr)

ppc64:
https://kojipkgs.fedoraproject.org//work/tasks/5475/19595475/build.log
== 619 tests, 8 stderr failures, 2 stdout failures, 14 stderrB failures, 0 stdoutB failures, 3 post failures ==
gdbserver_tests/hginfo (stderrB)
gdbserver_tests/mcblocklistsearch (stderrB)
gdbserver_tests/mcbreak (stderrB)
gdbserver_tests/mcclean_after_fork (stderrB)
gdbserver_tests/mcinfcallWSRU (stderrB)
gdbserver_tests/mcleak (stderrB)
gdbserver_tests/mcmain_pic (stderr)
gdbserver_tests/mcmain_pic (stderrB)
gdbserver_tests/mcvabits (stderrB)
gdbserver_tests/mssnapshot (stderrB)
gdbserver_tests/nlgone_abrt (stderrB)
gdbserver_tests/nlgone_exit (stderrB)
gdbserver_tests/nlgone_return (stderrB)
gdbserver_tests/nlpasssigalrm (stderrB)
gdbserver_tests/nlsigvgdb (stderrB)
memcheck/tests/bug340392 (stderr)
memcheck/tests/leak_cpp_interior (stderr)
memcheck/tests/linux/rfcomm (stderr)
memcheck/tests/ppc64/power_ISA2_05 (stderr)
memcheck/tests/ppc64/power_ISA2_07 (stderr)
memcheck/tests/vcpu_fnfns (stdout)
massif/tests/deep-D (post)
massif/tests/new-cpp (post)
massif/tests/overloaded-new (post)
none/tests/ppc64/jm-vmx (stdout)
none/tests/rlimit_nofile (stderr)
helgrind/tests/tc22_exit_w_lock (stderr)

i386:
https://kojipkgs.fedoraproject.org//work/tasks/5476/19595476/build.log
== 677 tests, 3 stderr failures, 0 stdout failures, 14 stderrB failures, 1 stdoutB failure, 2 post failures ==
gdbserver_tests/hginfo (stderrB)
gdbserver_tests/hgtls (stdoutB)
gdbserver_tests/mcblocklistsearch (stderrB)
gdbserver_tests/mcbreak (stderrB)
gdbserver_tests/mcclean_after_fork (stderrB)
gdbserver_tests/mcinfcallWSRU (stderrB)
gdbserver_tests/mcleak (stderrB)
gdbserver_tests/mcmain_pic (stderr)
gdbserver_tests/mcmain_pic (stderrB)
gdbserver_tests/mcvabits (stderrB)
gdbserver_tests/mssnapshot (stderrB)
gdbserver_tests/nlgone_abrt (stderrB)
gdbserver_tests/nlgone_exit (stderrB)
gdbserver_tests/nlgone_return (stderrB)
gdbserver_tests/nlpasssigalrm (stderrB)
gdbserver_tests/nlsigvgdb (stderrB)
memcheck/tests/leak_cpp_interior (stderr)
massif/tests/new-cpp (post)
massif/tests/overloaded-new (post)
none/tests/rlimit_nofile (stderr)

s390x:
https://kojipkgs.fedoraproject.org//work/tasks/5477/19595477/build.log
== 717 tests, 55 stderr failures, 3 stdout failures, 14 stderrB failures, 0 stdoutB failures, 2 post failures ==
gdbserver_tests/hginfo (stderrB)
gdbserver_tests/mcblocklistsearch (stderrB)
gdbserver_tests/mcbreak (stderrB)
gdbserver_tests/mcclean_after_fork (stderrB)
gdbserver_tests/mcinfcallWSRU (stderrB)
gdbserver_tests/mcleak (stderrB)
gdbserver_tests/mcmain_pic (stderr)
gdbserver_tests/mcmain_pic (stderrB)
gdbserver_tests/mcvabits (stderrB)
gdbserver_tests/mssnapshot (stderrB)
gdbserver_tests/nlgone_abrt (stderrB)
gdbserver_tests/nlgone_exit (stderrB)
gdbserver_tests/nlgone_return (stderrB)
gdbserver_tests/nlpasssigalrm (stderrB)
gdbserver_tests/nlsigvgdb (stderrB)
memcheck/tests/client-msg-as-xml (stderr)
memcheck/tests/client-msg (stderr)
memcheck/tests/deep-backtrace (stderr)
memcheck/tests/demangle (stderr)
memcheck/tests/inline (stderr)
memcheck/tests/inlinfo (stderr)
memcheck/tests/inlinfosupp (stderr)
memcheck/tests/inlinfosuppobj (stderr)
memcheck/tests/leak_cpp_interior (stderr)
memcheck/tests/linux/timerfd-syscall (stderr)
memcheck/tests/memcmptest (stderr)
memcheck/tests/mempool (stderr)
memcheck/tests/mempool2 (stderr)
memcheck/tests/origin5-bz2 (stderr)
memcheck/tests/recursive-merge (stderr)
memcheck/tests/s390x/cds (stderr)
memcheck/tests/s390x/cdsg (stderr)
memcheck/tests/varinfo6 (stderr)
memcheck/tests/wrap6 (stdout)
massif/tests/new-cpp (post)
massif/tests/overloaded-new (post)
none/tests/libvexmultiarch_test (stderr)
none/tests/rlimit_nofile (stderr)
none/tests/s390x/fpconv (stdout)
none/tests/s390x/fpconv (stderr)
none/tests/s390x/pfpo (stdout)
none/tests/s390x/pfpo (stderr)
none/tests/vgprintf (stderr)
helgrind/tests/annotate_rwlock (stderr)
helgrind/tests/bar_bad (stderr)
helgrind/tests/cond_timedwait_invalid (stderr)
helgrind/tests/free_is_write (stderr)
helgrind/tests/hg02_deadlock (stderr)
helgrind/tests/hg03_inherit (stderr)
helgrind/tests/hg04_race (stderr)
helgrind/tests/hg05_race2 (stderr)
helgrind/tests/locked_vs_unlocked1_fwd (stderr)
helgrind/tests/locked_vs_unlocked1_rev (stderr)
helgrind/tests/locked_vs_unlocked2 (stderr)
helgrind/tests/locked_vs_unlocked3 (stderr)
helgrind/tests/pth_barrier1 (stderr)
helgrind/tests/pth_barrier2 (stderr)
helgrind/tests/pth_barrier3 (stderr)
helgrind/tests/pth_destroy_cond (stderr)
helgrind/tests/rwlock_race (stderr)
helgrind/tests/tc01_simple_race (stderr)
helgrind/tests/tc05_simple_race (stderr)
helgrind/tests/tc06_two_races (stderr)
helgrind/tests/tc06_two_races_xml (stderr)
helgrind/tests/tc09_bad_unlock (stderr)
helgrind/tests/tc14_laog_dinphils (stderr)
helgrind/tests/tc16_byterace (stderr)
helgrind/tests/tc19_shadowmem (stderr)
helgrind/tests/tc20_verifywrap (stderr)
helgrind/tests/tc21_pthonce (stderr)
helgrind/tests/tc22_exit_w_lock (stderr)
drd/tests/annotate_barrier (stderr)
drd/tests/annotate_barrier_xml (stderr)
drd/tests/pth_detached3 (stderr)

armv7hl:
https://kojipkgs.fedoraproject.org//work/tasks/5478/19595478/build.log
== 582 tests, 63 stderr failures, 0 stdout failures, 0 stderrB failures, 0 stdoutB failures, 2 post failures ==
memcheck/tests/dw4 (stderr)
memcheck/tests/err_disable3 (stderr)
memcheck/tests/err_disable4 (stderr)
memcheck/tests/leak-cases-full (stderr)
memcheck/tests/leak-cases-summary (stderr)
memcheck/tests/leak-cycle (stderr)
memcheck/tests/leak-segv-jmp (stderr)
memcheck/tests/leak-tree (stderr)
memcheck/tests/leak_cpp_interior (stderr)
memcheck/tests/linux/stack_changes (stderr)
memcheck/tests/lks (stderr)
memcheck/tests/origin5-bz2 (stderr)
memcheck/tests/partiallydefinedeq (stderr)
memcheck/tests/supp_unknown (stderr)
memcheck/tests/threadname (stderr)
memcheck/tests/threadname_xml (stderr)
memcheck/tests/varinfo1 (stderr)
memcheck/tests/varinfo2 (stderr)
memcheck/tests/varinfo3 (stderr)
memcheck/tests/varinfo4 (stderr)
memcheck/tests/varinfo5 (stderr)
memcheck/tests/varinfo6 (stderr)
memcheck/tests/varinforestrict (stderr)
massif/tests/new-cpp (post)
massif/tests/overloaded-new (post)
none/tests/rlimit_nofile (stderr)
helgrind/tests/annotate_rwlock (stderr)
helgrind/tests/bar_bad (stderr)
helgrind/tests/free_is_write (stderr)
helgrind/tests/hg02_deadlock (stderr)
helgrind/tests/hg03_inherit (stderr)
helgrind/tests/hg04_race (stderr)
helgrind/tests/hg05_race2 (stderr)
helgrind/tests/locked_vs_unlocked1_fwd (stderr)
helgrind/tests/locked_vs_unlocked1_rev (stderr)
helgrind/tests/locked_vs_unlocked2 (stderr)
helgrind/tests/locked_vs_unlocked3 (stderr)
helgrind/tests/pth_barrier1 (stderr)
helgrind/tests/pth_barrier2 (stderr)
helgrind/tests/pth_barrier3 (stderr)
helgrind/tests/pth_destroy_cond (stderr)
helgrind/tests/rwlock_race (stderr)
helgrind/tests/tc01_simple_race (stderr)
helgrind/tests/tc05_simple_race (stderr)
helgrind/tests/tc06_two_races (stderr)
helgrind/tests/tc06_two_races_xml (stderr)
helgrind/tests/tc09_bad_unlock (stderr)
helgrind/tests/tc14_laog_dinphils (stderr)
helgrind/tests/tc16_byterace (stderr)
helgrind/tests/tc19_shadowmem (stderr)
helgrind/tests/tc20_verifywrap (stderr)
helgrind/tests/tc21_pthonce (stderr)
helgrind/tests/tc22_exit_w_lock (stderr)
drd/tests/annotate_barrier (stderr)
drd/tests/annotate_barrier_xml (stderr)
drd/tests/annotate_trace_memory (stderr)
drd/tests/annotate_trace_memory_xml (stderr)
drd/tests/atomic_var (stderr)
drd/tests/hg03_inherit (stderr)
drd/tests/hg04_race (stderr)
drd/tests/hg05_race2 (stderr)
drd/tests/rwlock_race (stderr)
drd/tests/std_thread2 (stderr)
drd/tests/tc19_shadowmem (stderr)
drd/tests/tc21_pthonce (stderr)

Loading...