zephyr.git/tests/kernel/obj_validation/testcase.yaml#test :Evalution failure

[nashif]

Reported by rahul kumar:

This testcase Evaluation failed on the four platform mentioned below :-
1)mv
2)qemu-zephyr-x86
3)arduino101:x86
4)ma:x86

The Log console report is pasted below :-

tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: build passed
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: deploy (1 tries) passed
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: deploy passed
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: setting up
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: starting
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: Resetting
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86/arc: build passed
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: build passed
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86/arc: build passed
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: build passed
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: Reset
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: found expected `RunID: :fwvh` in console
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: ***** delaying boot 1000ms (per build configuration) *****
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: ***** BOOTING ZEPHYR OS v1.9.0 (delayed boot 1000ms) - BUILD: Sep 20 2017 05:45:37 *****
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: starting test - obj_validation
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004073b0 is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400000 is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0xffffffff is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400010 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400020 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400030 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400040 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400050 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400060 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400070 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400080 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400090 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000a0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000b0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000c0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000d0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000e0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000f0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400100 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400110 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: PASS - main.
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: ===================================================================
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: ===================================================================
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: RunID: :fwvh
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: PROJECT EXECUTION SUCCESSFUL
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: eval pass: found expected `RunID: :fwvh` in console `jfsotc03/qz31n-x86:default` at 1.95s
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: found expected `PROJECT EXECUTION SUCCESSFUL` in console `jfsotc03/qz31n-x86:default` at 1.95s
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: ***** delaying boot 1000ms (per build configuration) *****
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: ***** BOOTING ZEPHYR OS v1.9.0 (delayed boot 1000ms) - BUILD: Sep 20 2017 05:45:37 *****
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: starting test - obj_validation
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004073b0 is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400000 is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0xffffffff is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400010 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: starting test - obj_validation
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004073b0 is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400000 is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0xffffffff is not a k_sem
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400010 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400020 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400030 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400040 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400050 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400060 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400070 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400080 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400090 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000a0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000b0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000c0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000d0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000e0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x004000f0 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400100 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: 0x00400110 used before initialization
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: PASS - main.
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: ===================================================================
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: ===================================================================
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: RunID: :fwvh
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: console output: PROJECT EXECUTION SUCCESSFUL
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: eval pass: found expected `PROJECT EXECUTION SUCCESSFUL` in console `jfsotc03/qz31n-x86:default` at 1.95s
tests/kernel/obj_validation/testcase.yaml#testqz31n-x86:x86: evaluation passed
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: deploy (1 tries) passed
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: deploy passed
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: setting up
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: starting
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: Resetting
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: Reset
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: eval failed: found expected (for failure) `PROJECT EXECUTION FAILED` in console `srrsotc02/a101-04:default` at 6.17s
tests/kernel/obj_validation/testcase.yaml#test/a101-04:x86: evaluation failed
tests/kernel/obj_validation/testcase.yaml#testmv-02:x86: deploy (1 tries) passed
tests/kernel/obj_validation/testcase.yaml#testmv-02:x86: deploy passed
tests/kernel/obj_validation/testcase.yaml#testmv-02:x86: setting up
tests/kernel/obj_validation/testcase.yaml#testmv-02:x86: starting
tests/kernel/obj_validation/testcase.yaml#testmv-02:x86: Resetting
tests/kernel/obj_validation/testcase.yaml#testmv-02:x86: Reset
tests/kernel/obj_validation/testcase.yaml#testmv-02:x86: eval failed: found expected (for failure) `PROJECT EXECUTION FAILED` in console `jfsotc04/mv-02:default` at 2.20s
tests/kernel/obj_validation/testcase.yaml#testmv-02:x86: evaluation failed
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: deploy (1 tries) passed
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: deploy passed
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: deploy (1 tries) passed
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: deploy passed
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: setting up
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: starting
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: Resetting
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: Reset
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: eval failed: found expected (for failure) `PROJECT EXECUTION FAILED` in console `local/QA-qc1000-01:default` at 1.32s
tests/kernel/obj_validation/testcase.yaml#testqc1000-01:x86: evaluation failed

(Imported from Jira ZEP-2627)

[nashif]

by rahul kumar:

This above testcase failure report is pasted below :

tests/kernel/obj_validation/testcase.yaml#test @ qc1000-01:x86 COMPLETION failed
Detailed description
====================
Automated test run failed.

Output (the target might have produced none; GDB will be needed at this point):

 will run on target group
 configure passed
 build output: Merging /home/rrahulkx/zephyr/zephyr/tests/include/test.config
 build output: Merging prj.conf
 build output: Merging /tmp/run-qYFHST/ufb8/outdir-ufb8-bj2z-quark_se_c1000_devboard/arc_target.conf
 build output: Merging /tmp/run-qYFHST/ufb8/outdir-ufb8-bj2z-quark_se_c1000_devboard/boot_config.conf
 build output: #
 build output: # configuration written to .config
 build output: #
arc  build output: Merging /home/rrahulkx/zephyr/zephyr/tests/include/test.config
arc  build output: Merging prj.conf
arc  build output: Merging /tmp/run-qYFHST/ufb8/outdir-ufb8-bj2z-quark_se_c1000_ss_devboard/arc_target.conf
arc  build output: Merging /tmp/run-qYFHST/ufb8/outdir-ufb8-bj2z-quark_se_c1000_ss_devboard/boot_stub_config.conf
arc  build output: #
arc  build output: # configuration written to .config
arc  build output: #
 deployed (try 1/4) set([(u'kernel-arc', u'/tmp/run-qYFHST/ufb8/outdir-ufb8-bj2z-quark_se_c1000_ss_devboard/zephyr.bin'), (u'kernel-x86', u'/tmp/run-qYFHST/ufb8/outdir-ufb8-bj2z-quark_se_c1000_devboard/zephyr.bin')])
 deploy (1 tries) passed
 deploy passed
 Reset
 eval failed: found expected (for failure) `PROJECT EXECUTION FAILED` in console `qc1000-01:default` at 1.32s
 console output: ***** delaying boot 1000ms (per build configuration) *****
 console output: ***** BOOTING ZEPHYR OS v1.9.0 (delayed boot 1000ms) - BUILD: Sep 20 2017 05:45:37 *****
 console output: starting test - obj_validation
 console output: FAIL - main.
 console output: ===================================================================
 console output: ===================================================================
 console output: RunID: :bj2z
 console output: PROJECT EXECUTION FAILED
 eval failed trace: Traceback (most recent call last):
 eval failed trace:   File "/usr/lib/python2.7/site-packages//tc.py", line 1514, in _decorated_fn
 eval failed trace:     r = fn(*args, **kwargs)
 eval failed trace:   File "/usr/lib/python2.7/site-packages//tc.py", line 3043, in _method_run
 eval failed trace:     return self.__method_trampoline_call(fname, fn, _type, targets)
 eval failed trace:   File "/usr/lib/python2.7/site-packages//tc.py", line 2999, in __method_trampoline_call
 eval failed trace:     r = getattr(self, fname)(*targets)
 eval failed trace:   File "/usr/lib/python2.7/site-packages/tc_zephyr_sanity.py", line 606, in eval
 eval failed trace:     console = target.rt.get("console", None))
 eval failed trace:   File "/usr/lib/python2.7/site-packages/tc.py", line 1031, in expect
 eval failed trace:     self.testcase.expecter.run()
 eval failed trace:   File "/usr/lib/python2.7/site-packages/expecter.py", line 255, in run
eval failed trace:   File "/usr/lib/python2.7/site-packages/expecter.py", line 255, in run
 eval failed trace:     r = f(*args)
 eval failed trace:   File "/usr/lib/python2.7/site-packages/expecter.py", line 451, in console_rx_eval
 eval failed trace:     { 'target': target, "console output": of })
 eval failed trace: failed_e: (u'found expected (for failure) `PROJECT EXECUTION FAILED` in console `qc1000-01:default` at 1.32s', {'console output': <open file u'/tmp/.run-qYFHST/ufb8/eval-buffers-00-0/console-qc1000-01:ufb8-default.log', mode 'a+' at 0x7fd9b4041420>, 'target': <.tc.target_c object at 0x7fd9b40d72d0>})
 evaluation failed
 COMPLETION failed