How to turn off Find My iPhone (and when you definitely should)

What happened
Find My is a vital iPhone security feature that you should keep on almost all the time. Turning it off makes your device much harder to recover.
Summary assembled by rule from the sources below