Release 2015.12 - RC1

[miri64]

This issue lists the status of all tests for the Release Candidate 1 of the 2015.12 release.

Specs tested:

• 01-CI
  • Task 01
  • Task 02
  • Task 03
    • some fib_sr tests still failing (see fib_sr: unittests for fib_sr fail sporadically RIOT#4513)
  • Task 04
• 02-Tests
  • Task 01
    • periph_random: loops 1-18 are fast, all further are incredible slow. Sucks /dev/random dry.
    • periph_rtc: /usr/local/src/RIOT/tests/periph_rtc/bin/native/periph_rtc.elf: rtc_set_time: not implemented. No Alarms.
    • vtimer_msg_diff: WARNING: timer difference -13898us exceeds MAXDIFF(10000)!
    • xtimer_hang: Testing... (25%) make: *** [term] Segmentation fault
    • xtimer_usleep_until: 147 diff=3007\ too large difference.\ Test Failed Sometimes fails sometimes not.
  • Task 02
  • Task 03
• 03-Single Hop IPv6 ICMP
  • Task 01
  • Task 02
  • Task 03
• 04-Single Hop 6LoWPAN ICMP
  • Task 01
  • Task 02
  • Task 03
  • Task 04
• 05-Single Hop Route
  • Task 01
  • Task 02
  • Task 03
• 06-Single Hop UDP
  • not working due to gnrc_sixlowpan: Fix IPHC/NHC packet order problem RIOT#4485 not being merged yet
• 07-Multi Hop
  • Task 01
  • Task 02
  • Task 03
  • Task 04
• 08-Interop
  • Task 01
  • Task 02
  • Task 03
  • Task 04
  • Task 05

[miri64]

For all testers: this issue refers to commit RIOT-OS/RIOT@8ec1fd4.

[miri64]

I'm testing 01-CI right now.

[miri64]

And 03.

[miri64]

While 03.03 is running (takes 1h) I'm taking doing 04.

[miri64]

I use the following patch to test 06:

diff --git a/examples/gnrc_networking/udp.c b/examples/gnrc_networking/udp.c
index af10651..926a1ae 100644
--- a/examples/gnrc_networking/udp.c
+++ b/examples/gnrc_networking/udp.c
@@ -30,7 +30,7 @@
 #include "xtimer.h"

 static gnrc_netreg_entry_t server = { NULL, GNRC_NETREG_DEMUX_CTX_ALL, KERNEL_PID_UNDEF };
-
+static uint16_t data_buffer[512];

 static void send(char *addr_str, char *port_str, char *data, unsigned int num,
                  unsigned int delay)
@@ -38,6 +38,11 @@ static void send(char *addr_str, char *port_str, char *data, unsigned int num,
     uint8_t port[2];
     uint16_t tmp;
     ipv6_addr_t addr;
+    data = (char *)&data_buffer[0];
+
+    for (uint16_t i = 0; i < 512; i++) {
+        data[i] = i;
+    }

     /* parse destination address */
     if (ipv6_addr_from_str(&addr, addr_str) == NULL) {
@@ -56,7 +61,7 @@ static void send(char *addr_str, char *port_str, char *data, unsigned int num,
     for (unsigned int i = 0; i < num; i++) {
         gnrc_pktsnip_t *payload, *udp, *ip;
         /* allocate payload */
-        payload = gnrc_pktbuf_add(NULL, data, strlen(data), GNRC_NETTYPE_UNDEF);
+        payload = gnrc_pktbuf_add(NULL, data, sizeof(data_buffer), GNRC_NETTYPE_UNDEF);
         if (payload == NULL) {
             puts("Error: unable to copy data to packet buffer");
             return;

[A-Paul]

Some words to 02-Tests Task 1
For every directory wih a main.c that is @ingoup tests I compiled and ran make term.
For a bunch of tests I hope they succeeded, but there were no information how to distinguish the output.

[miri64]

For many there are pexpect scripts in a subdirectory (typically tests). They describe, what the test expects.

[miri64]

And you mean 02 instead of 01, right?

[miri64]

And thanks for testing :-)

[A-Paul]

And you mean 02 instead of 01, right?

Yes! Corrected.

[A-Paul]

For many there are pexpect scripts in a subdirectory (typically tests)

Well, at least a handfull. ;-)

paul@hedon:/usr/local/src/RIOT/tests$ find . -type d -name tests
./pthread_cleanup/tests
./posix_semaphore/tests
./msg_send_receive/tests
./thread_basic/tests
./shell/tests
./xtimer_msg_receive_timeout/tests

But those were already fairly obvious. All succeeded btw.

[miri64]

Well then there is something we have as a target for next release: improve test automation :-D

[miri64]

Closed in favor of #11