Ok. I found out what's causing the problem. If I adjust the brightness to anything other than 1.0, it messes up the background color. I dunno if anyone can test this and see if this happens in any of the games I listed. But at least I found a workaround. I just better make sure I don't adjust the brightness of those games
Windows 11 64 bit OS
Intel Core i7-10700
Nvidia GeForce RTX 2060 6GB
32GB DDR4 RAM