The files were in ascii. I've adjusted my loading code a bit to check for a binary file. If there is no binary file, I convert the ascii file to binary so that the next time will be quicker. And boy, do things get quicker :)<div>
Loading the ascii files takes about 77 seconds. Loading the binary files takes around 1(!!!) second!</div><div>So thanks for the tip.</div><div><br></div><div>Cheers,</div><div>Tijmen</div><div><br><div class="gmail_quote">
On Fri, Oct 14, 2011 at 2:55 PM, Michael Jackson <span dir="ltr"><<a href="mailto:mike.jackson@bluequartz.net">mike.jackson@bluequartz.net</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Are those files binary or ascii? Loading binary vtk files can be very<br>
quick where their ascii versions are much slower. I have as much as a<br>
10x speed up going from ascii to binary format.<br>
<br>
-----<br>
Mike Jackson <a href="http://www.bluequartz.net" target="_blank">www.bluequartz.net</a><br>
Principal Software Engineer <a href="mailto:mike.jackson@bluequartz.net">mike.jackson@bluequartz.net</a><br>
BlueQuartz Software Dayton, Ohio<br>
Sent from my mobile device.<br>
<div><div></div><div class="h5"><br>
On Oct 14, 2011, at 8:02, Tijmen Klein <<a href="mailto:T.R.Klein@student.rug.nl">T.R.Klein@student.rug.nl</a>> wrote:<br>
<br>
> I have an application that loads 70 files of data in the legacy VTK format. 35 files contain scalar data, and 35 files contain vector data. The scalar files are around 4MB per file, and the vector files around 12MB.<br>
> However, loading all scalar files (with a vtkStructuredPointsReade) takes around 12 seconds, loading all vector files takes around 65 seconds. That's more than 5 times slower, while the files are only 3 times larger.<br>
><br>
> Is there a explanation for this difference in speed, and is there a way to increase the loading speed of those vector files? Would converting (all) files to a different format help with the loading time? Waiting 77 seconds before the data is loaded is a bit much.<br>
><br>
> Cheers,<br>
> Tijmen<br>
</div></div>> _______________________________________________<br>
> Powered by <a href="http://www.kitware.com" target="_blank">www.kitware.com</a><br>
><br>
> Visit other Kitware open-source projects at <a href="http://www.kitware.com/opensource/opensource.html" target="_blank">http://www.kitware.com/opensource/opensource.html</a><br>
><br>
> Please keep messages on-topic and check the VTK FAQ at: <a href="http://www.vtk.org/Wiki/VTK_FAQ" target="_blank">http://www.vtk.org/Wiki/VTK_FAQ</a><br>
><br>
> Follow this link to subscribe/unsubscribe:<br>
> <a href="http://www.vtk.org/mailman/listinfo/vtkusers" target="_blank">http://www.vtk.org/mailman/listinfo/vtkusers</a><br>
</blockquote></div><br></div>