xubuntu – Installing XFCE on Ubuntu 24.04 (with default Gnome Desktop)

I installed Ubuntu 24.04 with Gnome / Wayland recently and installed XFCE additionally with lightdm. When checking my graphics I get

Graphics:
  Device-1: AMD driver: amdgpu v: kernel
  Display: x11 server: X.Org v: 21.1.11 with: Xwayland v: 23.2.6 driver: X:
    loaded: amdgpu unloaded: fbdev,modesetting,vesa dri: radeonsi gpu: amdgpu
    resolution: 1920x1080~60Hz
  API: EGL v: 1.5 drivers: radeonsi,swrast platforms: x11,surfaceless,device
  API: OpenGL v: 4.6 compat-v: 4.5 vendor: amd mesa v: 24.0.9-0ubuntu0.3
    renderer: AMD Radeon Graphics (radeonsi raphael_mendocino LLVM 17.0.6 DRM
    3.57 6.8.0-51-generic)

When booting a Xubuntu live iso however I’m getting:

Graphics:
Device-1: AMD driver: amdgpu v: kernel
Display: x11 server: X.Org v: 21.1.11 driver: X: loaded: amdgpu
unloaded: fbdev,modesetting,vesa dri: radeonsi gpu: amdgpu
resolution: 1920x1080~60Hz

So, the Ubuntu XFCE session still uses Xwayland while the Xubuntu session is a pure x11 session. Is there any way to get rid of Xwayland or is it ok to just leave it? Is there any drawback when using Ubuntu with XFCE compared to Xubuntu?