Running Emby version 22.214.171.124.
From Web interface, it seems Emby's shuffle for a music genre results on choosing a sole random album and playing all tracks from this album.
It also seems this behaviour does not occur when casting from the android app to a Chromecast.
Tried also to navigate to the all music section, filter the music by genre and then shuffle it. Got same result.