I think this may happen with a lot of people looking at the Little Brown Jobs. Most New Englanders who watch birds should be able to ID at least 4 out of 5 in this quiz.
Of course, that is easy for me to say about LBJs. If someone said the same thing to me about peeps or gulls, I might consider them delusional. Having experience with birds goes a long way toward removing the ID mysteries.