Add:
LIBS += -L/directory/with/library/xyz -lxyz
INCLUDEPATH += /directory/with/xyz/headers
to your .pro file.