I don't understand.
Yocto is not a distro - its a packaging tool, a distro maker if you will.

If you are cross compiling you will need a cross compiled version of Qt as well.
The serial port module is available on all Qt supported platform *I think* - but the docs can probably help.