How to stylize WordPress image caption

By default, WordPress stylizes your image captions in a way that might not perfectly match your theme design. However, we can dramatically change it just by applying some CSS on the right classes.