[vtk-developers] Coverage

Sat Mar 2 18:25:25 EST 2013

I just sent a list of files to vtk-devel that shows what is
newly-disabled in master as compared to release.

And I've attached another file that includes the full path
to each disabled test.

 - David

On Sat, Mar 2, 2013 at 4:10 PM, Berk Geveci <berk.geveci at kitware.com> wrote:
> Can you generate this as a list of files? Then one or more of us has
> to go through these and either remove them or make them work again.
>
> -berk
>
> On Sat, Mar 2, 2013 at 5:21 PM, David Gobbi <david.gobbi at gmail.com> wrote:
>> There are also a number of tests that aren't being run.  I wrote a
>> python script (attached) that looks through all the Testing
>> directories and identifies test programs that don't appear in a
>> CMakeLists.txt file.  It reports:
>>
>>  166 out of 1770 tests are not enabled
>>  44 are commented out, the rest are unlisted in cmake
>>
>> Compare this to VTK 5.10:
>>
>>  54 out of 1213 tests are not enabled
>>  21 are commented out, the rest are unlisted in cmake
>>
>> It's probably more informative to list the tests by language:
>>
>> Cxx: 132 not enabled (39 in cmake but commented out)
>> Tcl: 19 not enabled (2 in cmake but commented out)
>> Python: 15 not enabled (3 in cmake but commented out)
>>
>> Recently Bill and others have done an awesome job of reactivating tcl
>> and python tests, but a large number of C++ tests are still
>> missing/disabled.
>>
>>  - David
>>
>>
>> On Sat, Mar 2, 2013 at 1:46 PM, Berk Geveci <berk.geveci at kitware.com> wrote:
>>> Yup. One other thing that we would like to try in the near future is
>>> to look at combined VTK + ParaView coverage of VTK. ParaView tests
>>> some of VTK more thoroughly and that should increase coverage further.
>>> I am hoping for 70%. Beyond that, we will have to write more tests.
>>>
>>> -berk
>>>
>>> On Sat, Mar 2, 2013 at 10:08 AM, Bill Lorensen <bill.lorensen at gmail.com> wrote:
>>>> Berk,
>>>>
>>>> Looks like tcl and python were added to ubuntu coverage. Now it is showing
>>>> 66%.
>>>>
>>>> Bill
-------------- next part --------------
Accelerators/Piston/Testing/Python/PistonTestCommon.py
Charts/Core/Testing/Cxx/TestContextUnicode.cxx
Charts/Core/Testing/Cxx/TestFreeTypeRender.cxx
Charts/Core/Testing/Cxx/TestGLSL.cxx
Charts/Core/Testing/Cxx/TestQtContextUnicode.cxx
Charts/Core/Testing/Cxx/TestQtDiagram.cxx
# Common/Core/Testing/Cxx/TestArrayCasting.cxx
# Common/Core/Testing/Cxx/TestCxxFeatures.cxx
# Common/Core/Testing/Cxx/TestInstantiator.cxx
Common/Core/Testing/Cxx/TestVariantArray.cxx
Common/DataModel/Testing/Cxx/CellLocator.cxx
Common/DataModel/Testing/Cxx/CellLocator2.cxx
Common/DataModel/Testing/Cxx/PointLocator.cxx
Common/DataModel/Testing/Cxx/TestGraph2.cxx
Common/DataModel/Testing/Cxx/TestGraphAttributes.cxx
Common/DataModel/Testing/Cxx/TestMeanValueCoordinatesInterpolation1.cxx
Common/DataModel/Testing/Cxx/TestMeanValueCoordinatesInterpolation2.cxx
Common/DataModel/Testing/Cxx/TestSmoothErrorMetric.cxx
Common/DataModel/Testing/Cxx/TestTable.cxx
Common/Transforms/Testing/Python/SliceOrder.py
Common/Transforms/Testing/Tcl/SliceOrder.tcl
Domains/Chemistry/Testing/Cxx/TestOpenQubeElectronicData.cxx
Domains/Chemistry/Testing/Cxx/TestOpenQubeMOPACDensity.cxx
Domains/Chemistry/Testing/Cxx/TestOpenQubeMOPACOrbital.cxx
# Filters/Core/Testing/Cxx/TestAppendPolyData.cxx
Filters/Core/Testing/Cxx/TestNamedComponents.cxx
Filters/Core/Testing/Python/SliceOrder.py
Filters/Core/Testing/Tcl/SliceOrder.tcl
Filters/General/Testing/Cxx/ArrayExtractFactoredArray.cxx
Filters/General/Testing/Cxx/ArrayMatricizeArray.cxx
Filters/General/Testing/Cxx/ArrayNormalizeMatrixVectors.cxx
Filters/General/Testing/Cxx/CellTreeLocator.cxx
Filters/General/Testing/Cxx/TestPassArrays.cxx
Filters/General/Testing/Cxx/TestPassThrough.cxx
Filters/General/Testing/Cxx/TestTableSplitColumnComponents.cxx
Filters/General/Testing/Cxx/TestTessellator.cxx
Filters/General/Testing/Cxx/expCos.cxx
Filters/Geometry/Testing/Cxx/TestRectilinearGridPartitioner.cxx
Filters/Geometry/Testing/Cxx/TestStructuredGridPartitioner.cxx
# Filters/Hybrid/Testing/Cxx/TestBSplineWarp.cxx
Filters/Matlab/Testing/Cxx/TestMatlabEngineFilter.cxx
Filters/Matlab/Testing/Cxx/TestMatlabEngineInterface.cxx
# Filters/ParallelStatistics/Testing/Cxx/TestRealDataPDescriptiveStatisticsMPI.cxx
Filters/Sources/Testing/Cxx/ArrayAPIDenseCoordinates.cxx
Filters/Sources/Testing/Cxx/ArrayDiagonalMatrixSource.cxx
Filters/Sources/Testing/Tcl/Disk.tcl
Filters/Sources/Testing/Tcl/OSCone.tcl
Filters/Sources/Testing/Tcl/TestButtonSource.tcl
Filters/Sources/Testing/Tcl/TestPlatonicSolids.tcl
Filters/Sources/Testing/Tcl/TestRegularPolygonSource.tcl
Filters/Sources/Testing/Tcl/coneResolution.tcl
Filters/Sources/Testing/Tcl/glyph2D.tcl
GUISupport/Qt/Testing/Python/TestConnection.py
GUISupport/Qt/Testing/Python/TestQVTKRenderWindowInteractor.py
GUISupport/Qt/Testing/Python/TestQVTKWidget.py
GUISupport/Qt/Testing/Python/TestQVTKWidget2.py
GUISupport/Qt/Testing/Python/TestTimeUtility.py
GUISupport/Qt/Testing/Python/TestvtkQtTableView.py
GUISupport/QtSQL/Testing/Cxx/TestQtSQLDatabase.cxx
IO/AMR/Testing/Cxx/TestAMRReadWrite.cxx
# IO/AMR/Testing/Cxx/TestFlashReader.cxx
IO/Geometry/Testing/Cxx/TestDataObjectIO.cxx
IO/Geometry/Testing/Cxx/TestIncrementalOctreePointLocator.cxx
IO/Geometry/Testing/Cxx/UnstructuredGridCellGradients.cxx
IO/Geometry/Testing/Cxx/UnstructuredGridFastGradients.cxx
IO/Geometry/Testing/Cxx/UnstructuredGridGradients.cxx
# IO/Geometry/Testing/Python/TestPolygonWriters.py
# IO/Image/Testing/Cxx/TestImageReader2Factory.cxx
IO/Infovis/Testing/Cxx/TestDIMACSGraphReader.cxx
IO/Infovis/Testing/Cxx/TestDelimitedTextReader.cxx
IO/Infovis/Testing/Cxx/TestFixedWidthTextReader.cxx
IO/Infovis/Testing/Cxx/TestISIReader.cxx
IO/Infovis/Testing/Cxx/TestRISReader.cxx
# IO/Infovis/Testing/Cxx/TestTulipReader.cxx
# IO/Infovis/Testing/Cxx/TestTulipReaderClusters.cxx
# IO/Movie/Testing/Cxx/TestMovieWriter.cxx
IO/SQL/Testing/Cxx/TestSQLGraphReader.cxx
IO/XML/Testing/Cxx/TestHyperOctreeIO.cxx
# IO/XML/Testing/Tcl/TestXMLPolyDataIO.tcl
# IO/XML/Testing/Tcl/TestXMLUnstructuredGridIO.tcl
# Imaging/Core/Testing/Cxx/FastSplatter.cxx
# Imaging/Core/Testing/Cxx/ImageAutoRange.cxx
# Imaging/Core/Testing/Cxx/ImageHistogram.cxx
# Imaging/Core/Testing/Cxx/ImageHistogramStatistics.cxx
# Imaging/Core/Testing/Cxx/ImageResize.cxx
# Imaging/Core/Testing/Cxx/ImageResize3D.cxx
# Imaging/Core/Testing/Cxx/ImageResizeCropping.cxx
# Imaging/Core/Testing/Cxx/ImportExport.cxx
# Imaging/Core/Testing/Python/WindowLevelInterface.py
Imaging/Core/Testing/Tcl/WindowLevelInterface.tcl
# Infovis/BoostGraphAlgorithms/Testing/Cxx/BoostArrayLogWeighting.cxx
# Infovis/BoostGraphAlgorithms/Testing/Cxx/TestBoostBrandesCentrality.cxx
Infovis/Core/Testing/Cxx/ArrayDotProductSimilarity.cxx
# Infovis/Core/Testing/Cxx/TestArrayNorm.cxx
# Infovis/Core/Testing/Cxx/TestConvexHull2D.cxx
Infovis/Core/Testing/Cxx/TestKCoreDecomposition.cxx
Infovis/Core/Testing/Cxx/TestStringToCategory.cxx
Infovis/Core/Testing/Cxx/TestTableToGraph.cxx
# Infovis/Core/Testing/Cxx/TestTimePoint.cxx
Infovis/Layout/Testing/Cxx/TestArcEdges.cxx
# Infovis/Layout/Testing/Cxx/TestAssignCoordinates.cxx
# Infovis/Layout/Testing/Cxx/TestChacoGraphReader.cxx
# Infovis/Layout/Testing/Cxx/TestCosmicTreeLayoutStrategy.cxx
Infovis/Layout/Testing/Cxx/TestGroupLeafVertices.cxx
Infovis/Layout/Testing/Cxx/TestKCoreLayout.cxx
Infovis/Layout/Testing/Cxx/TestKdTreeBoxSelection.cxx
Infovis/Layout/Testing/Cxx/TestPruneTreeFilter.cxx
Infovis/Layout/Testing/Cxx/TestSimple3DCirclesStrategy.cxx
Interaction/Style/Testing/Python/TestStyleBase.py
Interaction/Style/Testing/Tcl/TestStyleBase.tcl
# Interaction/Widgets/Testing/Cxx/ImagePlaneWidget.cxx
Interaction/Widgets/Testing/Cxx/ScaledBoxWidget2.cxx
Interaction/Widgets/Testing/Cxx/TestAxesTransformWidget.cxx
# Interaction/Widgets/Testing/Cxx/TestBrokenLineWidget.cxx
# Interaction/Widgets/Testing/Cxx/TestButtonWidget.cxx
Interaction/Widgets/Testing/Cxx/TestCaptionWidget.cxx
# Interaction/Widgets/Testing/Cxx/TestImageActorContourWidget.cxx
Interaction/Widgets/Testing/Cxx/TestOrientedGlyphContour.cxx
# Interaction/Widgets/Testing/Cxx/TestOrthoPlanes.cxx
# Interaction/Widgets/Testing/Cxx/TestResliceCursorWidget2.cxx
# Interaction/Widgets/Testing/Cxx/TestResliceCursorWidget3.cxx
# Interaction/Widgets/Testing/Cxx/TestSplineWidget.cxx
Interaction/Widgets/Testing/Cxx/vtkImplicitPlaneRepresentationTest1.cxx
Interaction/Widgets/Testing/Cxx/vtkImplicitPlaneWidget2Test1.cxx
Interaction/Widgets/Testing/Cxx/vtkOrientedPolygonalHandleRepresentation3DTest1.cxx
Interaction/Widgets/Testing/Cxx/vtkPointHandleRepresentation2DTest1.cxx
Interaction/Widgets/Testing/Cxx/vtkPointHandleRepresentation3DTest1.cxx
Interaction/Widgets/Testing/Cxx/vtkPolygonalHandleRepresentation3DTest1.cxx
Interaction/Widgets/Testing/Cxx/vtkSphereHandleRepresentationTest1.cxx
Interaction/Widgets/Testing/Cxx/vtkSplineRepresentationTest1.cxx
Parallel/Core/Testing/Python/DummyController.cxx
Parallel/Core/Testing/Python/SocketClient.cxx
Parallel/Core/Testing/Python/SocketServer.cxx
Parallel/Core/Testing/Python/TestSockets.py
# Rendering/Annotation/Testing/Cxx/TestAxisActor3D.cxx
Rendering/Core/Testing/Cxx/FrustumClip.cxx
Rendering/Core/Testing/Cxx/Mace.cxx
Rendering/Core/Testing/Cxx/RGrid.cxx
Rendering/Core/Testing/Cxx/TestActor2DTextures.cxx
Rendering/Core/Testing/Cxx/TestBareScalarsToColors.cxx
# Rendering/Core/Testing/Cxx/TestHierarchicalBoxPipeline.cxx
Rendering/Core/Testing/Cxx/TestMapVectorsAsRGBColors.cxx
Rendering/Core/Testing/Cxx/TestMapVectorsToColors.cxx
Rendering/Core/Testing/Cxx/TestTDxGeo.cxx
Rendering/Core/Testing/Cxx/TestViewDependentErrorMetric.cxx
# Rendering/Core/Testing/Cxx/otherLookupTable.cxx
# Rendering/Core/Testing/Cxx/otherLookupTableWithEnabling.cxx
# Rendering/Core/Testing/Python/TestParallelCoordinates.py
Rendering/Core/Testing/Tcl/TestCgShader.tcl
Rendering/Core/Testing/Tcl/TestGLSLShader.tcl
Rendering/Core/Testing/Tcl/TestGenericVertexAttributesCg.tcl
Rendering/Core/Testing/Tcl/TestGenericVertexAttributesGLSL.tcl
Rendering/Core/Testing/Tcl/TestParallelCoordinates.tcl
Rendering/OpenGL/Testing/Cxx/TestMultiTexturingGLSL.cxx
Rendering/OpenGL/Testing/Cxx/TestQtImages.cxx
Rendering/OpenGL/Testing/Cxx/TestQtLabelSizeCalculator.cxx
Rendering/OpenGL/Testing/Cxx/TestQtLabeler.cxx
Rendering/Qt/Testing/Cxx/TestQtInitialization.cxx
Rendering/Tk/Testing/Python/cursor3D.py
Rendering/Tk/Testing/Tcl/TestTextActor3D.tcl
Views/Geovis/Testing/Cxx/TestGeoView.cxx
Views/Geovis/Testing/Cxx/TestGeoView2D.cxx
Views/Geovis/Testing/Cxx/TestGeoView2DPopulation.cxx
Views/Infovis/Testing/Cxx/TestQtLabelStrategy.cxx
Views/Infovis/Testing/Cxx/TestQtTreeRingLabeler.cxx
Views/Qt/Testing/Cxx/TestVtkQtTableView.cxx
166 out of 1770 tests are not enabled
44 are commented out, the rest are unlisted