RK3288 was true open source. It boots with just u-boot and no blobs. DDR init was done by u-boot code and armv7 didn't require a TEE.
RK3588 is "almost" open. It boots with mainline u-boot and device tree from the Linux kernel, but needs two blobs: the DDR training blob and the trustzone blob (BL31). It can run without a TEE OS. I recently heard that the BL31 is now open source, but I didn't look into it.
Mainline kernel has support for everything, including 3d (panthor driver) and video codecs acceleration (you find it in the v4l submenu). Mainline Mesa driver (panfrost) also works, but... not great - it stutters/freezes when I move the mouse.
Xorg works, it uses the generic modesetting driver which is accelerated by Mesa panfrost driver, but like I said, with stuttering and temporary freezes when I move the mouse. It happens in all apps: moving windows, vkgears, glxgears, mpv video playback, but "mpv -vo gpu -hwdec=vaapi" started from console plays fine, very smooth. I didn't try Xlibre or wayland.
RK3588 is "almost" open. It boots with mainline u-boot and device tree from the Linux kernel, but needs two blobs: the DDR training blob and the trustzone blob (BL31). It can run without a TEE OS. I recently heard that the BL31 is now open source, but I didn't look into it. Mainline kernel has support for everything, including 3d (panthor driver) and video codecs acceleration (you find it in the v4l submenu). Mainline Mesa driver (panfrost) also works, but... not great - it stutters/freezes when I move the mouse.