Having same issue, its annoying how badly gamepass is locked down, even when using linux distro on pc to delete the suggested files from pc, xbox app downloads them again, rendering it completely useless for gamepass players.
System Spec:
Ryzen 5 2600 stock
Asus B450-F
16GB 3200MHz DDR4
MSI RTX 3070 Gaming X Trio
Samsung 970 Evo Plus NVME