I want to read a huge binary file and parse it. the file can be over 100GB.
any idea how can i do that ??
thanks
Intermediate user
read a huge file over 100GB
I want to read a huge binary file and parse it. the file can be over 100GB.
any idea how can i do that ??
thanks
The "Q"
Re: read a huge file over 100GB
Piece by piece
Your biological and technological distinctiveness will be added to our own. Resistance is futile.
Please ask Qt related questions on the forum and not using private messages or visitor messages.
Expert
Re: read a huge file over 100GB
Just like any other binary file, only take care to read only the amount of data which after parsing and decoding can fit in the system's available RAM
When you know how to do it then you may do it wrong.
When you don't know how to do it then it is not that you may do it wrong but you may not do it right.
Guru
Re: read a huge file over 100GB
Reminds me of the last time I tried to eat an elephant...
The feasibility/difficulty of parsing a binary file piecemeal is strongly dependent on the internal structures of the file, something we do not have information on.
Posting Permissions
Reply With Quote
Bookmarks