I found out that if my foot joint’s rotation is not completely “flat” on XZ plane (using Y-up), the result rotation (if connect joints is checked) is offset slightly.
Is there a way to maybe fix it in the future? I can fix the rotations no problem, but it did take me like 30 minutes to figure out why it was wrong.