God is very specific about what makes Him angry: waivering between Him and other objects of worship; starting to follow Him then stopping; or ignoring Him altogether.