Running Emby version 220.127.116.11.
From Web interface, it seems Emby's shuffle for a music genre results on choosing a sole random album and playing all tracks from this album.
It also seems this behaviour does not occur when casting from the android app to a Chromecast.
Tried also to navigate to the all music section, filter the music by genre and then shuffle it. Got same result.