MantisBT - ParaView
View Issue Details
0010270ParaViewBugpublic2010-02-10 08:542016-08-12 09:57
Berk Geveci 
Kitware Robot 
normalmajorhave not tried
closedmoved 
 
 
0010270: ParaView reads too much
When opening a file with a serial reader while running in parallel, all processes read the whole data and then redistribution occurs. See below. We need to make sure that, for all data types, when a serial reader is used and when there is only 1 file, only the first process reads the data and partitions it to other processes.

Wait a sec... I am not sure I agree with with you after all. Upon closer inspection it looks to me like all of the process do end up with a copy of the entire dataset in memory when using legacy readers. At the very least in between the read and the automagic PV load balancing you pointed out, possibly longer depending on how long the pipeline holds the reader output.

It looks as though legacy files are read by PV using vtkPDataSetReader. I put a couple print statements that show process Id and the number of points read on each process during request data. See the attached patch. When I run multiple pvservers all processes output the same response as a serial run.

For example, using "CylinderQuadratic.vtk" as a test case i get:

$mpiexec -np 2 bin/pvserver --server-port=22222
Listen on port: 22222
Waiting for client...
Waiting for server...
Client connected.
1 Read 2814
0 Read 2814

while with just the builtin I get:

0 Read 2814
No tags attached.
Issue History
2010-02-10 08:54Berk GeveciNew Issue
2010-02-10 08:55Berk GeveciTarget Version => 3.8
2010-04-16 01:39Utkarsh AyachitTarget Version3.8 => 3.10
2016-08-12 09:57Kitware RobotNote Added: 0037783
2016-08-12 09:57Kitware RobotStatusexpired => closed
2016-08-12 09:57Kitware RobotResolutionopen => moved
2016-08-12 09:57Kitware RobotAssigned To => Kitware Robot

Notes
(0037783)
Kitware Robot   
2016-08-12 09:57   
Resolving issue as `moved`.

This issue tracker is no longer used. Further discussion of this issue may take place in the current ParaView Issues page linked in the banner at the top of this page.