500f73b1aa
Running repeated invocations on a number of test boxes show a fairly high error rate: $ retry.py -n 100 -c -- ./tests/venv/bin/avocado run tests/avocado/boot_linux_console.py:BootLinuxConsole.test_sh4_r2d retry.py called with ['./tests/venv/bin/avocado', 'run', 'tests/avocado/boot_linux_console.py:BootLinuxConsole.test_sh4_r2d'] Results: Run, Ret, Pass/Fail, Time, Total Pass, Total Run ... Results summary: 0: 94 times (94.00%), avg time 2.254 (0.00 varience/0.04 deviation) 1: 3 times (3.00%), avg time 1.837 (0.02 varience/0.14 deviation) 8: 3 times (3.00%), avg time 91.288 (0.02 varience/0.15 deviation) Examining the logs they fall into various categories of un-handled unaligned access by user space and unexpected FPU usage by the kernel which ultimately lead to the failure to reach the login prompt. This could be bugs in the translator that only get hit occasionally or just a flaky kernel - its hard to tell. To avoid these failures gating CI lets skip on GitLab. Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org> Signed-off-by: Alex Bennée <alex.bennee@linaro.org> Cc: Thomas Huth <thuth@redhat.com> Cc: Yoshinori Sato <ysato@users.sourceforge.jp> Cc: Magnus Damm <magnus.damm@gmail.com> Message-Id: <20221027183637.2772968-21-alex.bennee@linaro.org> |
||
|---|---|---|
| .. | ||
| avocado_qemu | ||
| virtiofs_submounts.py.data | ||
| boot_linux_console.py | ||
| boot_linux.py | ||
| boot_xen.py | ||
| cpu_queries.py | ||
| empty_cpu_model.py | ||
| hotplug_cpu.py | ||
| info_usernet.py | ||
| intel_iommu.py | ||
| linux_initrd.py | ||
| linux_ssh_mips_malta.py | ||
| load_bflt.py | ||
| machine_aarch64_virt.py | ||
| machine_arm_canona1100.py | ||
| machine_arm_integratorcp.py | ||
| machine_arm_n8x0.py | ||
| machine_aspeed.py | ||
| machine_avr6.py | ||
| machine_m68k_nextcube.py | ||
| machine_microblaze.py | ||
| machine_mips_fuloong2e.py | ||
| machine_mips_loongson3v.py | ||
| machine_mips_malta.py | ||
| machine_rx_gdbsim.py | ||
| machine_s390_ccw_virtio.py | ||
| machine_sparc64_sun4u.py | ||
| machine_sparc_leon3.py | ||
| migration.py | ||
| multiprocess.py | ||
| pc_cpu_hotplug_props.py | ||
| ppc_74xx.py | ||
| ppc_405.py | ||
| ppc_bamboo.py | ||
| ppc_mpc8544ds.py | ||
| ppc_prep_40p.py | ||
| ppc_pseries.py | ||
| ppc_virtex_ml507.py | ||
| README.rst | ||
| replay_kernel.py | ||
| replay_linux.py | ||
| reverse_debugging.py | ||
| smmu.py | ||
| tcg_plugins.py | ||
| tesseract_utils.py | ||
| version.py | ||
| virtio_check_params.py | ||
| virtio_version.py | ||
| virtio-gpu.py | ||
| virtiofs_submounts.py | ||
| vnc.py | ||
| x86_cpu_model_versions.py | ||
============================================= Integration tests using the Avocado Framework ============================================= This directory contains integration tests. They're usually higher level, and may interact with external resources and with various guest operating systems. For more information, please refer to ``docs/devel/testing.rst``, section "Integration tests using the Avocado Framework".