What it works is the other way : compile in 32bits on a 64 bits machine by settings makefile flags :

QMAKE_CXXFLAGS += -m32
QMAKE_LFLAGS += -m32

After ensuring yourself that the libs you link against are compatibles.