Four Heads are Better than None