PC takes a couple cold starts to boot

Specs:

MSI B650M Mortar Wifi
R7 7800X3D
RTX 2070
G. Skill Flare X5 32GB 6000MT/s
Corsair HX1200i PSU

As the title says, my PC does not boot on first start up. Whenever I shut down the computer or even put it to sleep for a while, it will fail to boot or go into Windows until I shut it back down and try again once or twice.
On first cold boot, the EZ debug lights will light up with solid yellow on DRAM and solid red on CPU. It will stay like this with fans on the GPU spinning at max RPM until I shut it down and try again. When I restart the system, it will show the same lights and everything but after a while, the CPU light will turn off, DRAM will be on then successfully post after a little bit.

This has been extremely frustrating for me and has been an issue for me this whole week. I only just built the system last week. Any help would be appreciated.

Also, my PC/mouse cursor seems to stutter very often, especially when loading a tab or opening a program. If anyone has any tips for this, that would be great.