Reading Japanese chars from QNetworkReply

[Antidote]

I've written a feed parser, however i'm having trouble reading japanese characters, I.E
Antidoteæ¼¢å*—
shows up as
Antidoteæ¼¢å*—
Which is clearly wrong, it seems that i'm not setting my header correctly

{
    QUrl url("http://zfgc.com/forum/index.php?action=.xml");
 
    QNetworkRequest request(url);
    request.setRawHeader( "User-Agent", "Mozilla/5.0 (X11; U; Linux i686 (x86_64); "
                               "en-US; rv:1.9.0.1) Gecko/2008070206 Firefox/3.0.1" );
    request.setRawHeader( "charset", "utf-8" );
    request.setRawHeader( "Connection", "keep-alive" );
    m_networkAccess->get(request);
}

{
    QUrl url("http://zfgc.com/forum/index.php?action=.xml");

    QNetworkRequest request(url);
    request.setRawHeader( "User-Agent", "Mozilla/5.0 (X11; U; Linux i686 (x86_64); "
                               "en-US; rv:1.9.0.1) Gecko/2008070206 Firefox/3.0.1" );
    request.setRawHeader( "charset", "utf-8" );
    request.setRawHeader( "Connection", "keep-alive" );
    m_networkAccess->get(request);
}

To copy to clipboard, switch view to plain text mode 

Any help would be greatly appreciated thanks.

I should probably post my DOM parser as well just incase the issue is there

QTextStream xmlData(m_data);
    xmlData.setCodec("UTF-8");
    xmlData.setAutoDetectUnicode(true);
    QDomDocument doc;
    doc.implementation().setInvalidDataPolicy(QDomImplementation::AcceptInvalidChars);
    doc.setContent(xmlData.readAll());
 
 
    QDomNodeList nodeList = doc.documentElement().elementsByTagName("recent-post");
 
    for (int i = 0; i < nodeList.count(); i++)
    {
        qint32 id = -1;
        QPair<QString, QPair<QString, QString> > pair;
 
        QDomElement el = nodeList.at(i).toElement();
 
        QDomNode entry = el.firstChild();
 
        while(!entry.isNull())
        {
            QDomElement eData = entry.toElement();
            QString tagName = eData.tagName();
 
            if (tagName == "id" && id == -1)
            {
                id = eData.text().toInt();
                if (m_feedMap.contains(id) || m_pending.contains(id))
                    id = -1;
            }
            else if (tagName == "poster" && pair.first.isEmpty())
            {
                QDomNodeList posterChildren = eData.childNodes();
 
                for (int j = 0; j < posterChildren.count(); j++)
                {
                    QDomElement child = posterChildren.at(j).toElement();
                    if (child.tagName() == "name")
                    {
                        pair.first = child.text();
                    }
                }
            }
            else if (tagName == "subject" && pair.second.first.isEmpty())
            {
                pair.second.first = eData.text();
            }
            else if (tagName == "link" && pair.second.second.isEmpty())
            {
                pair.second.second = eData.text();
            }
 
            entry = entry.nextSibling();
        }
 
        if (id != -1)
        {
            if (m_pending.count() >= 6)
                m_pending.erase(m_pending.begin());
 
            if (!m_feedMap.contains(id) && !m_pending.contains(id))
                m_pending.insert(id, pair);
        }
    }

QTextStream xmlData(m_data);
    xmlData.setCodec("UTF-8");
    xmlData.setAutoDetectUnicode(true);
    QDomDocument doc;
    doc.implementation().setInvalidDataPolicy(QDomImplementation::AcceptInvalidChars);
    doc.setContent(xmlData.readAll());


    QDomNodeList nodeList = doc.documentElement().elementsByTagName("recent-post");

    for (int i = 0; i < nodeList.count(); i++)
    {
        qint32 id = -1;
        QPair<QString, QPair<QString, QString> > pair;

        QDomElement el = nodeList.at(i).toElement();

        QDomNode entry = el.firstChild();

        while(!entry.isNull())
        {
            QDomElement eData = entry.toElement();
            QString tagName = eData.tagName();

            if (tagName == "id" && id == -1)
            {
                id = eData.text().toInt();
                if (m_feedMap.contains(id) || m_pending.contains(id))
                    id = -1;
            }
            else if (tagName == "poster" && pair.first.isEmpty())
            {
                QDomNodeList posterChildren = eData.childNodes();

                for (int j = 0; j < posterChildren.count(); j++)
                {
                    QDomElement child = posterChildren.at(j).toElement();
                    if (child.tagName() == "name")
                    {
                        pair.first = child.text();
                    }
                }
            }
            else if (tagName == "subject" && pair.second.first.isEmpty())
            {
                pair.second.first = eData.text();
            }
            else if (tagName == "link" && pair.second.second.isEmpty())
            {
                pair.second.second = eData.text();
            }

            entry = entry.nextSibling();
        }

        if (id != -1)
        {
            if (m_pending.count() >= 6)
                m_pending.erase(m_pending.begin());

            if (!m_feedMap.contains(id) && !m_pending.contains(id))
                m_pending.insert(id, pair);
        }
    }

To copy to clipboard, switch view to plain text mode 

[ChrisW67]

There is no standard "charset" HTTP request header: try "Accept-Charset".
The character set returned comes back in the Content-Type header: have you checked that?

You should just feed the raw QByteArray of received data into the QDomDocument and let it worry about the encoding (specified in the xml header). No need for a QTextStream.

[Antidote]

Alright i'll give that a shot thanks

Content-Type is "text/xml; charset=UTF-8" but the data is still incorrect

[Antidote]

I figured it out, I was converting text to UTF-8 unnecessarily (msg.toUtf8()) before outputting the data to my IRC tcp socket.
Completely my fault