I think the text doesn't depend on the font size, thus you should adjust the font size while drawing the text and not when setting it on the widget. And probably when you do, you'll have the proper font set up on the painter or at least in the style option initialized from the widget. Text size doesn't make sense outside painting routines. The label won't even have the width calculated before it is first shown and I guess you'd want to have a possibility to call this method before the widget is shown.
Bookmarks