Maybe it would be enough to provide an own item delegate for the header view?