Lot of latency through my Behringer UMC22.

So I realized how problematic this is when I'm recording some guitar tracks, and going through playback, I realized the tracks were out of time because of said latency despite playing on time with the tracks (by turning off monitoring through Reaper and keeping monitoring on my Behringer.)

As stupid as it sounds, I thought only the DAW monitoring was affected, and not actually affecting my recording.
How do I fix this latency?