The only reference to Dr. Samuel Johnson having said this is in "The Devil's Dictionary" by Ambrose Bierce.