How can we test our ratio­nal­ity and var­i­ous biases?

Shouldn’t you get more ratio­nal­ity credit if you spend more time study­ing com­mon biases, sta­tis­ti­cal tech­niques, and the like?  Well this would be good evi­dence of your ratio­nal­ity if you were in fact pretty ratio­nal about your ratio­nal­ity, i.e., if you knew that when you read or dis­cussed such issues your mind would then sys­tem­at­i­cally, broadly, and rea­son­ably incor­po­rate those insights into you rea­son­ing processes.

But what if your mind is far from ratio­nal?  What if your mind is likely to just go through the motions of study­ing ratio­nal­ity to allow itself to smugly believe it is more accu­rate, or to bond you more closely to your social allies?

So just because you know of all the cog­ni­tive biases and fal­lac­ies doesn’t mean you’re not going to fall vic­tim to the bias blind spot or actu­ally become more rational.

This puts me in mind of this (para­phrased) quote from an anony­mous adver­tis­ing executive:

Those who claim to be well versed in the ‘psy­chol­ogy of adver­tis­ing’ and to there­fore be ‘immune’ not only don’t know much about psy­chol­ogy or adver­tis­ing, but are our ideal targets.