The angle of the engines moves the thrust line closer to the center of gravity, thereby reducing the moment arm and therefore reducing the induced yaw from one engine flight that needs to be countered by the rudder. So, this configuration is actually more directionally stable under single engine flight than if the thrust line was parallel to the fuselage.
The same principle applies to the Ju-52 outer engines.