Gamescope is not working after using Wayland session

[ProgKing]

Is there an existing issue for this?

• I have searched the existing issues

Are you using any gamescope patches or a forked version of gamescope?

• The issue occurs on upstream gamescope without any modifications

Current Behavior

I used Wayland previously but returned to X11, and now Gamescope is not working at all. When I run gamescope -f -- glxgears, I get the following errors:

[gamescope] [Info]  console: gamescope version 3.16.1 (gcc 14.2.1)
[gamescope] [Info]  scriptmgr: Loading scripts from: '/usr/share/gamescope/scripts'
[gamescope] [Info]  scriptmgr: Loading scripts from: '/usr/share/gamescope/scripts/00-gamescope'
[gamescope] [Info]  scriptmgr: Loading scripts from: '/usr/share/gamescope/scripts/00-gamescope/common'
[gamescope] [Info]  scriptmgr: Running script file '/usr/share/gamescope/scripts/00-gamescope/common/inspect.lua' (id: 0)
[gamescope] [Info]  scriptmgr: Running script file '/usr/share/gamescope/scripts/00-gamescope/common/modegen.lua' (id: 1)
[gamescope] [Info]  scriptmgr: Running script file '/usr/share/gamescope/scripts/00-gamescope/common/util.lua' (id: 2)
[gamescope] [Info]  scriptmgr: Loading scripts from: '/usr/share/gamescope/scripts/00-gamescope/displays'
[gamescope] [Info]  scriptmgr: Running script file '/usr/share/gamescope/scripts/00-gamescope/displays/asus.rogally.lcd.lua' (id: 3)
[gamescope] [Info]  scriptmgr: Running script file '/usr/share/gamescope/scripts/00-gamescope/displays/deckhd.steamdeck.deckhd-lcd.lua' (id: 4)
[gamescope] [Info]  scriptmgr: Running script file '/usr/share/gamescope/scripts/00-gamescope/displays/valve.steamdeck.lcd.lua' (id: 5)
[gamescope] [Info]  scriptmgr: Running script file '/usr/share/gamescope/scripts/00-gamescope/displays/valve.steamdeck.oled.lua' (id: 6)
[gamescope] [Info]  scriptmgr: Loading scripts from: '/etc/gamescope/scripts'
[gamescope] [Warn]  scriptmgr: Directory '/etc/gamescope/scripts' does not exist
[gamescope] [Info]  scriptmgr: Loading scripts from: '/home/progfan/.config/gamescope/scripts'
[gamescope] [Warn]  scriptmgr: Directory '/home/progfan/.config/gamescope/scripts' does not exist
[gamescope] [Info]  vulkan: selecting physical device 'NVIDIA GeForce GTX 1050 Ti': queue family 2 (general queue family 0)
[gamescope] [Info]  vulkan: physical device supports DRM format modifiers
[gamescope] [Info]  wlserver: [backend/headless/backend.c:67] Creating headless backend
[gamescope] [Error] vulkan: vkGetPhysicalDeviceFormatProperties2 returned zero modifiers for DRM format 0x38344241 (VkResult: 0)
[gamescope] [Error] vulkan: vkGetPhysicalDeviceFormatProperties2 returned zero modifiers for DRM format 0x38344258 (VkResult: 0)
[gamescope] [Info]  vulkan: supported DRM formats for sampling usage:
[gamescope] [Info]  vulkan: Creating Gamescope nested swapchain with format 44 and colorspace 0
gamescope: types/wlr_linux_dmabuf_v1.c:532: feedback_compile: Assertion `table_len > 0' failed.
[1]    49239 IOT instruction (core dumped)  gamescope -f -- glxgears

When I attempt to run Gamescope via Lutris, I get these errors:

[gamescope] [�[0;34mInfo�[0m]  �[0;37mconsole:�[0m gamescope version 3.16.1 (gcc 14.2.1)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Loading scripts from: '/usr/share/gamescope/scripts'
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Loading scripts from: '/usr/share/gamescope/scripts/00-gamescope'
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Loading scripts from: '/usr/share/gamescope/scripts/00-gamescope/common'
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Running script file '/usr/share/gamescope/scripts/00-gamescope/common/inspect.lua' (id: 0)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Running script file '/usr/share/gamescope/scripts/00-gamescope/common/modegen.lua' (id: 1)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Running script file '/usr/share/gamescope/scripts/00-gamescope/common/util.lua' (id: 2)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Loading scripts from: '/usr/share/gamescope/scripts/00-gamescope/displays'
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Running script file '/usr/share/gamescope/scripts/00-gamescope/displays/asus.rogally.lcd.lua' (id: 3)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Running script file '/usr/share/gamescope/scripts/00-gamescope/displays/deckhd.steamdeck.deckhd-lcd.lua' (id: 4)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Running script file '/usr/share/gamescope/scripts/00-gamescope/displays/valve.steamdeck.lcd.lua' (id: 5)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Running script file '/usr/share/gamescope/scripts/00-gamescope/displays/valve.steamdeck.oled.lua' (id: 6)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Loading scripts from: '/etc/gamescope/scripts'
[gamescope] [�[0;33mWarn�[0m]  �[0;37mscriptmgr:�[0m Directory '/etc/gamescope/scripts' does not exist
[gamescope] [�[0;34mInfo�[0m]  �[0;37mscriptmgr:�[0m Loading scripts from: '/home/progfan/.config/gamescope/scripts'
[gamescope] [�[0;33mWarn�[0m]  �[0;37mscriptmgr:�[0m Directory '/home/progfan/.config/gamescope/scripts' does not exist
[gamescope] [�[0;34mInfo�[0m]  �[0;37mvulkan:�[0m selecting physical device 'NVIDIA GeForce GTX 1050 Ti': queue family 2 (general queue family 0)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mvulkan:�[0m physical device supports DRM format modifiers
[gamescope] [�[0;34mInfo�[0m]  �[0;37mwlserver:�[0m [backend/headless/backend.c:67] Creating headless backend
[gamescope] [�[0;31mError�[0m] �[0;37mvulkan:�[0m vkGetPhysicalDeviceFormatProperties2 returned zero modifiers for DRM format 0x38344241 (VkResult: 0)
[gamescope] [�[0;31mError�[0m] �[0;37mvulkan:�[0m vkGetPhysicalDeviceFormatProperties2 returned zero modifiers for DRM format 0x38344258 (VkResult: 0)
[gamescope] [�[0;34mInfo�[0m]  �[0;37mvulkan:�[0m supported DRM formats for sampling usage:
[gamescope] [�[0;34mInfo�[0m]  �[0;37mvulkan:�[0m Creating Gamescope nested swapchain with format 44 and colorspace 0
gamescope: types/wlr_linux_dmabuf_v1.c:532: feedback_compile: Assertion `table_len > 0' failed.
Monitored process exited.
Initial process has exited (return code: 134)
All processes have quit
Exit with return code 134

Steps To Reproduce

1. Run gamescope in Terminal/Lutris/Steam
2. Notice errors

Hardware information

- Distro: Arch
- CPU: Ryzen 7 1700
- GPU: GTX 1050ti
- Driver Version: 565.77

Software information

- Desktop environment: Qtile X11
- Session type: x11
- Gamescope version: 3.16.1 (gcc 14.2.1)
- Gamescope launch command(s): gamescope -f -w 1920 -h 1080 -r 60 -- %command% or gamescope -f -- glxgears

Which gamescope backends have the issue you are reporting?

• Wayland (default for nested gamescope)
• DRM (default for embedded gamescope, i.e. gamescope-session)
• SDL
• OpenVR

Logging, screenshots, or anything else

No response

[matte-schwartz]

this was resolved with #1548 but has not made it into a release version yet.