Its making me crazy. There is a phrase that officially describes the idea of "selective memory". Basically its the tendency to remember the facts that support your argument or preconceived notion, and forget the things that refute it.
For example, lets say you think your internet is slow. You will tend to remember the times when it lagged or hung and forget the times when it zipped or whipped by.