You can't change the default font size. You can change the default font for everything that uses a font in the preferences dialog, but not the size.
It's easy to change the size for an object that uses a font: select the object and click the toolbar button with the little +aA or -aA and the font size will increase/decrease accordingly. Works for dimension lines, text labels, displayed object names, area sizes on rooms, etc.