Large File Problem

14 Mar 2011

I have a project with several large byte arrays. Each array is in a separate file and takes the form:

const uint8_t GAS_8S22[] = {0x80, 0x80, 0x80, 0x80, 0x80, 0x82, 0x7F, 0x73, 0x63, 0x53, 0x47, 0x3F, 0x3D, ................. 0x41, 0x4A, 0x59, 0x65, 0x68, 0x5C, 0x44, 0x2F, 0x2D, 0x45, 0x69};

The array sizes are 73,310, 13,808, 68244, 21,332, and 91,649, but with six characters per byte and a couple of thousand linefeeds the file sizes are 442KB, 84KB, 412KB, 129KB, and 553KB.

I create each file using an off-line editor, and import the files into the project. The import function will only let me import one file per mbed session. (I have to log out, close the browser, open the browser, and log in to load another file.)

I have all five loaded and the program compiles OK gives me a 290K .bin file that seems to work OK, but in the project I cannot open any of the array files to view the data. If I try I get a 'timeout' message and everything hangs. I have to close the browser and start over.

14 Mar 2011

Hi John,

Can you tell us what browser, browser version and OS you are using? Some have better implementations than others when it comes to handling huge files, so perhaps try another browser if possible to see if you get workable results. We'll take a look to see if we can improve the behaviour of handling huge files like this, at least in a more elegant way than timeouts.

Thanks, Simon

14 Mar 2011

Hi Simon, Operating system WinXP SP3. Browser Firefox 5.0. I switched to Chrome 10.0 and the loading and viewing problems went away.

I should have thought of it maybe being a browser problem.

Thanks John

P.S. These were 'large' files. You have not seen 'huge' yet, but with 500MB of flash, someone is going to fill it.