Here is a nice way to look at error measures …

Link : What Is the Error if the Probability of Rain Is .5 and It Rains?