Does this also happen on a small project?

gdb generally may takes ages to load debug information
of "big" libraries, especially if it's in separate files as Qt's.