ESPAsyncWebServer and the C3

[joba-1]

Hi,

I am porting a project of mine from ESP32 to ESP32-C3.
The project uses the me-no-dev ESPAsyncWebServer for dynamic and static webpages.
I am aware of the 0U->0UL bug and fixed it, so it compiles.
Basic functionality works (e.g. I can do online updates).
But when I open the main web page (which loads static scripts from FS and probably actually does multiple reuqests in parallel), the ESP-C3 crashes while the "traditional" ESP32 works.

Currently it is hard to debug because the linux com port always renames itself on reboots, so for now only a general question:

Is this a known issue with the ESP32-C3? What is the best ESPAsyncWebServer lib for the C3 (ideal would be if it is drop in compatible...)

Here is the link to my project: https://github.com/joba-1/SliderPwm/compare/port-c3?expand=1

[joba-1]

Tried the ESPAsyncWebServerESP32C3 lib as offered by platformio library manager and got a stack trace.

Startup messages, all good

Starting SliderPwm v1.6 Sep 15 2023 12:38:11
*wm:AutoConnect 
*wm:Connecting to SAVED AP: job.fritz.ssid
*wm:connectTimeout not set, ESP waitForConnectResult... 
*wm:AutoConnect: SUCCESS 
*wm:STA IP Address: 192.168.1.165
SliderPwm Version 1.6, WLAN{"Version":1.6,"Hostname":"sliderpwm-3","Wifi":{"BSSID":"28:d1:27:4e:6b:9d","IP":"192.168.1.165","RSSI":-60}}
{"Version":1.6,"Hostname":"sliderpwm-3","Wifi":{"BSSID":"28:d1:27:4e:6b:9d","IP":"192.168.1.165","RSSI":-55}}

Request web page

Guru Meditation Error: Core  0 panic'ed (Load access fault). Exception was unhandled.

Core  0 register dump:
MEPC    : 0x4200870a  RA      : 0x4200875e  SP      : 0x3fcac440  GP      : 0x3fc8cc00  
=> 0x4200870a: String::buffer() const at /home/joachim/.platformio/packages/framework-arduinoespressif32@src-3d9b316d421f0ee8ddb211366d893d60/cores/esp32/WString.h:342 (discriminator 2)
      (inlined by) String::c_str() const at /home/joachim/.platformio/packages/framework-arduinoespressif32@src-3d9b316d421f0ee8ddb211366d893d60/cores/esp32/WString.h:250 (discriminator 2)
      (inlined by) AsyncWebServerRequest::_removeNotInterestingHeaders() at .pio/libdeps/esp32-c3-mini_ota/ESPAsyncWebServerESP32C3/src/WebRequest.cpp:184 (discriminator 2)
=> 0x4200875e: LinkedList<AsyncWebHeader*, LinkedListNode>::Iterator::operator++() at .pio/libdeps/esp32-c3-mini_ota/ESPAsyncWebServerESP32C3/src/StringArray.h:53 (discriminator 3)
      (inlined by) AsyncWebServerRequest::_removeNotInterestingHeaders() at .pio/libdeps/esp32-c3-mini_ota/ESPAsyncWebServerESP32C3/src/WebRequest.cpp:183 (discriminator 3)
TP      : 0x3fc9fb20  T0      : 0x403889b6  T1      : 0xfffffff0  T2      : 0x00008003  
=> 0x403889b6: vPortExitCritical at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/freertos/port/riscv/port.c:259
S0/FP   : 0x3fc972dc  S1      : 0x3fcae8c0  A0      : 0x00000001  A1      : 0xee5ecd6b  
A2      : 0x3fcadae4  A3      : 0x00000001  A4      : 0x3fc95ac4  A5      : 0x600c2000  
A6      : 0xffffffff  A7      : 0x0000000a  S2      : 0x3fc96384  S3      : 0x3fcae8d0  
S4      : 0x3fcae96c  S5      : 0x00000001  S6      : 0x0000000a  S7      : 0x00000004  
S8      : 0x00000000  S9      : 0x00000000  S10     : 0x00000000  S11     : 0x00000000  
T3      : 0x2e706172  T4      : 0x7473746f  T5      : 0x6f622f01  T6      : 0x00006ae2  
MSTATUS : 0x00001881  MTVEC   : 0x40380001  MCAUSE  : 0x00000005  MTVAL   : 0xee5ecd7a  
=> 0x40380001: _vector_table at ??:?
MHARTID : 0x00000000  

Stack memory:
3fcac440: 0x00000000 0x00000000 0x00000000 0x0400ad66 0x0000000a 0x00000001 0x3fcae8f4 0x00000002
3fcac460: 0x3fcaec7a 0x00000002 0x3fcae8c0 0x420087e0 0x3fcaec7a 0x00000002 0x3fcae8f4 0x420168d8
=> 0x420087e0: AsyncWebServerRequest::_parseLine() at .pio/libdeps/esp32-c3-mini_ota/ESPAsyncWebServerESP32C3/src/WebRequest.cpp:572
      (inlined by) AsyncWebServerRequest::_parseLine() at .pio/libdeps/esp32-c3-mini_ota/ESPAsyncWebServerESP32C3/src/WebRequest.cpp:554
=> 0x420168d8: String::concat(char const*) at /home/joachim/.platformio/packages/framework-arduinoespressif32@src-3d9b316d421f0ee8ddb211366d893d60/cores/esp32/WString.cpp:383
3fcac480: 0x0000000a 0x00000001 0x3fcae8f4 0x00000002 0x3fcaec7a 0x00000002 0x3fcae8c0 0x420088de
=> 0x420088de: AsyncWebServerRequest::_onData(void*, unsigned int) at .pio/libdeps/esp32-c3-mini_ota/ESPAsyncWebServerESP32C3/src/WebRequest.cpp:124
3fcac4a0: 0x00000002 0x00000005 0x3fcad874 0x3fc96000 0x00001800 0x0000000c 0x00000000 0x4038239e
=> 0x4038239e: heap_caps_malloc at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/heap/heap_caps.c:174
3fcac4c0: 0x00000002 0x3fcade48 0x3fcade34 0x00000001 0x00000000 0x3fcaeb08 0x3fcadddc 0x42008aae
=> 0x42008aae: std::_Function_handler<void (void*, AsyncClient*, void*, unsigned int), AsyncWebServerRequest::AsyncWebServerRequest(AsyncWebServer*, AsyncClient*)::{lambda(void*, AsyncClient*, void*, unsigned int)#8}>::_M_invoke(std::_Any_data const&, void*&&, AsyncClient*&&, std::_Any_data const&, unsigned int&&) at /home/joachim/.platformio/packages/toolchain-riscv32-esp/riscv32-esp-elf/include/c++/8.4.0/bits/std_function.h:299
3fcac4e0: 0x00000000 0x3fcaeb08 0x3fcadddc 0x420895c0 0x3fcae8c0 0x3fcadddc 0x3fcaeb56 0x00000126
=> 0x420895c0: AsyncClient::_recv(tcp_pcb*, pbuf*, signed char) at .pio/libdeps/esp32-c3-mini_ota/AsyncTCP/src/AsyncTCP.cpp:917
3fcac500: 0x00000002 0x00000005 0x3fcad874 0x3fc96000 0x3fc95bf4 0x00000001 0x3fcadd84 0x4208969c
=> 0x4208969c: AsyncClient::_s_recv(void*, tcp_pcb*, pbuf*, signed char) at .pio/libdeps/esp32-c3-mini_ota/AsyncTCP/src/AsyncTCP.cpp:1192
3fcac520: 0x3fc95bf4 0x00000001 0x3fcadd84 0x42089dca 0x00000000 0x3fcadd84 0x00000000 0x00000000
=> 0x42089dca: _async_service_task(void*) at .pio/libdeps/esp32-c3-mini_ota/AsyncTCP/src/AsyncTCP.cpp:159
      (inlined by) _async_service_task at .pio/libdeps/esp32-c3-mini_ota/AsyncTCP/src/AsyncTCP.cpp:194
3fcac540: 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000
3fcac560: 0x00000000 0x00000000 0x00000000 0x40388962 0x00000000 0x00000000 0x00000000 0x00000000
=> 0x40388962: _prvTaskExitError at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/freertos/port/riscv/port.c:127
      (inlined by) prvTaskExitError at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/freertos/port/riscv/port.c:140
3fcac580: 0x00000000 0xa5a5a5a5 0xa5a5a5a5 0xa5a5a5a5 0xa5a5a5a5 0xa5a5a5a5 0xa5a5a5a5 0x00000154
3fcac5a0: 0x3fcac070 0x3fc96384 0x3fc92034 0x3fc92034 0x3fcac5a0 0x3fc9202c 0x00000016 0x3fca84f0
3fcac5c0: 0x3fca84f0 0x3fcac5a0 0x00000000 0x00000003 0x3fca859c 0x6e797361 0x63745f63 0x00000070
3fcac5e0: 0x00cac590 0x00000000 0x3fcac590 0x00000003 0x00000000 0x3fcaccb4 0x4201ed5e 0x00000002
=> 0x4201ed5e: pthread_local_storage_thread_deleted_callback at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/pthread/pthread_local_storage.c:129
3fcac600: 0x3fc96c9c 0x3fc96d04 0x3fc96d6c 0x00000000 0x00000000 0x00000001 0x00000000 0x00000000
3fcac620: 0x00000000 0x4208b958 0x00000000 0x00000000 0x00000000 0x00000000 0x3fcac780 0x00000000
=> 0x4208b958: _cleanup_r at /builds/idf/crosstool-NG/.build/riscv32-esp-elf/src/newlib/newlib/libc/stdio/findfp.c:229
3fcac640: 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000
3fcac660: 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000
3fcac680: 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000
3fcac6a0: 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000
3fcac6c0: 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000
3fcac6e0: 0x00000000 0x00000000 0x00000000 0x00000000 0x3f000000 0x00000020 0x00000000 0x3fcac72c
3fcac700: 0x3fcac73c 0x3fcac71c 0x00000000 0x00000050 0x00000000 0x00000000 0x0000000c 0x64696c73
3fcac720: 0x77707265 0x00332d6d 0x0000000c 0x7474685f 0x3fc90070 0x3fcac724 0x0000000c 0x7063745f
3fcac740: 0x3fc96300 0x3fcac734 0x0000000c 0x00000000 0x3fcac6f8 0x3fcac744 0x00000020 0x00000308
3fcac760: 0x42068132 0x00000000 0x00000000 0x3fc986f4 0x3fc9c650 0x3fcadaf0 0x3fcac754 0x00000024
=> 0x42068132: wifi_get_ap_info_process at ??:?
3fcac780: 0x00000032 0x00000023 0x0000000e 0x0000000f 0x00000008 0x0000007b 0x00000005 0x00000101
3fcac7a0: 0x00000001 0x0000000c 0x00000003 0x3fcace70 0x00000000 0x00000010 0x3fca4fa0 0x0001299f
3fcac7c0: 0x420326be 0x00000000 0x0000004c 0x00000000 0x00000000 0x00000000 0x00000000 0x0641c000
=> 0x420326be: tcpip_tcp_timer at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/lwip/lwip/src/core/timeouts.c:157
3fcac7e0: 0xb7235300 0x89b95bd1 0xe33b38a0 0x343da9de 0x7d8e5400 0xff000000 0x00000000 0xff000000
3fcac800: 0x00000000 0x3fc90718 0x00000001 0x00500040 0x420898fe 0x3fca0005 0x0000001c 0x00000000
=> 0x420898fe: AsyncServer::_s_accept(void*, tcp_pcb*, signed char) at .pio/libdeps/esp32-c3-mini_ota/AsyncTCP/src/AsyncTCP.cpp:1332
3fcac820: 0x00a4e918 0x4202b6fe 0x00000000 0x3fc986f4 0x3fc9c650 0x3fcac814 0x00000054 0x00000000
=> 0x4202b6fe: sntp_request at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/lwip/lwip/src/apps/sntp/sntp.c:605



ELF file SHA256: 0000000000000000

Rebooting...
ESP-ROM:esp32c3-api1-20210207
Build:Feb  7 2021
rst:0x3 (RTC_SW_SYS_RST),boot:0xd (SPI_FAST_FLASH_BOOT)
Saved PC:0x40381c36
=> 0x40381c36: esp_restart_noos_dig at /home/runner/work/esp32-arduino-lib-builder/esp32-arduino-lib-builder/esp-idf/components/esp_system/esp_system.c:53 (discriminator 1)
SPIWP:0xee
mode:DIO, clock div:1
load:0x3fcd5810,len:0xf4
load:0x403cc710,len:0x8a0
=> 0x403cc710: ?? ??:0
load:0x403ce710,len:0x21f0
=> 0x403ce710: ?? ??:0
entry 0x403cc710
=> 0x403cc710: ?? ??:0

[joba-1]

One step further:
it has to do with serving the static pages. If I don't register them there is no crash.

Is there something special about the C3 and data files?

I use the min_spiffs.csv partition

And I did this to upload the fs:

pio run --target buildfs
pio run --target uploadfs

Both the ESP32 and the ESP-C3 firmware read and display a small boot message from the fs, so I know this worked.

[mathieucarbou]

@joba-1 : maybe have a look at our community maintained fork at https://github.com/mathieucarbou/ESPAsyncWebServer

[joba-1]

basically given up on the c3 due to pio/espressif divorce and no project demanding a c3. But having a maintained async webserver is really helpful.
I need it for realtime slider movement feedback. Thanks!

[mathieucarbou]

well, pioarduino is a PlatformIO community maintained fork which supports Arduino Core 3:

• https://github.com/pioarduino/platform-espressif32
• https://discord.gg/GRBX2hXBE3

[Jason2866]

@joba-1 As the head maintainer for pioarduino, a small note; Arduino support for esp32x based MCUs will be there even Platformio closes business.

[joba-1]

Hi!
I’m aware of pioarduino, already used it for an i2s and an rgb christmas project for S3s.
Thanks for your long term work on Tasmota and now pioarduino!

[joba-1]

just used your web server and AsyncTCPSock (github master) on an S3 for a bootstrap web page sending slider positions while moving them and for WifiManager with pioarduino (https://github.com/joba-1/SliderPwm).
Works great and without any web server related changes as better replacement, except I had to use -fpermissive to avoid this:

.pio/libdeps/esp32-s3-devkitc-12/AsyncTCPSock/src/AsyncTCP.cpp: In member function 'bool AsyncClient::getNoDelay()':
.pio/libdeps/esp32-s3-devkitc-12/AsyncTCPSock/src/AsyncTCP.cpp:355:76: error: invalid conversion from 'size_t*' {aka 'unsigned int*'} to 'socklen_t*' {aka 'long unsigned int*'} [-fpermissive]

not a big deal, just thought I bring it to your attention in case this is not intentional.

Thanks for the libs and the build environment!

[mathieucarbou]

Why are you using AsyncTCPSock ?

You can use AsyncTCP as described here:

https://github.com/mathieucarbou/ESPAsyncWebServer?tab=readme-ov-file#dependencies

In any case of you want / need to use AsyncTCPSock and have an issue you can open an issue in the right repository.

[joba-1]

I use AsyncTCPSock because I need to handle a lot of requests for the callbacks during fast slider movement and I got the impression from the readme performance section it is better than AsyncTCP for this.

I don't have an issue, socklen_t* vs size_t* is probably backwards compat vs correctness. It works, so its ok for me.

[mathieucarbou]

Ok! Well, yes AsyncTCPSock has better concurrency perf, but also has more issues when using see or websocket. All depends on what you do. But if a high rate of callbacks is necessary, I would definitely use websocket or sse because using a high rate of http calls on a MCU is quite intensive task which consumes a lof of resources.

Even if AsyncTCPSock perf for http concurrency show it is twice faster (serves 2 times more requests in the same time), it does not mean that this is better. To do that, it has to use more resources, so fewer left to the MCU for processing other more critical stuff.

I have an app with a ESP-DASH dashboard (MycilaJSY UDP sender) which sends some UDP paquets at a rate of moe than 3 paquets per second (a paquet is roughly 1K). ESP-DASH is websocket based. There is also a heavy task running on core 0 which communicates with a JSY to read power metrics using modbus at a rate of 20-25 requests/response per sec.

If I use AsyncTCPSock, then I sometimes have issues accessing the dashboard and I am not able to do an OTA through web if I keep sending UDP paquets. Whereas it works fine with AsyncTCP. Although they were teste using the same task priority.

So just wanted to highlight that AsyncTCPSock having better perf for small http calls does not automatically translate to AsyncTCPSock is better ;-)

[joba-1]

understood, thanks for the insight. I didn't quite understand the latency values - I certainly don't see reaction times of nearly 1s to even several seconds as listed in the readme - so I basically just tested which lib felt better and used that. Other stuff I'll use on the ESP will not be as performance or resource critical so I'm quite pleased with the result :)

[joba-1]

closing as original question is answered