1. Test Modules
  2. Network Diagram
  3. Performance
  4. Results

Subreport: Logs for com.simiacryptus.ref.lang.ReferenceCountingBase

Test Modules

Network Diagram

This is a network apply the following layout:

LayerTests.java:203 executed in 0.08 seconds (0.000 gc):

    return Graphviz.fromGraph((Graph) TestUtil.toGraph(((DAGNetwork) layer).addRef())).height(400).width(600)
        .render(Format.PNG).toImage();
Logging
executing command [/bin/sh, -c, dot -Tsvg /tmp/GraphvizJava/DotEngine7777943503369880332/dotfile.dot -ooutfile.svg]

Returns

Result

Using Seed 7921145433798760448

Performance

Now we execute larger-scale runs to benchmark performance:

PerformanceTester.java:120 executed in 1.19 seconds (0.041 gc):

    test(component == null ? null : component.addRef(), RefUtil.addRef(inputPrototype));
Logging
2 batch length, 5 trials
Input Dimensions:
[600, 600, 7]
Performance:
Evaluation performance: 0.023260s +- 0.002726s [0.020535s - 0.028512s]
Learning performance: 0.214422s +- 0.047161s [0.168684s - 0.275936s]

Per-key Performance Metrics:

TestUtil.java:185 executed in 0.00 seconds (0.000 gc):

    @Nonnull final RefMap<CharSequence, MonitoringWrapperLayer> metrics = new RefHashMap<>();
    network.visitNodes(RefUtil.wrapInterface(node -> {
      Layer nodeLayer = node.getLayer();
      if (nodeLayer instanceof MonitoringWrapperLayer) {
        @Nullable final MonitoringWrapperLayer layer = (MonitoringWrapperLayer) nodeLayer.addRef();
        Layer inner = layer.getInner();
        assert inner != null;
        String str = inner.toString();
        str += " class=" + inner.getClass().getName();
        inner.freeRef();
        RefUtil.freeRef(metrics.put(str, layer.addRef()));
        layer.freeRef();
      }
      assert nodeLayer != null;
      nodeLayer.freeRef();
      node.freeRef();
    }, metrics.addRef()));
    RefSet<Map.Entry<CharSequence, MonitoringWrapperLayer>> temp_13_0018 = metrics.entrySet();
    TestUtil.logger.info("Performance: \n\t" + RefUtil.orElse(temp_13_0018.stream()
        .sorted(RefComparator.comparingDouble(new ToDoubleFunction<Map.Entry<CharSequence, MonitoringWrapperLayer>>() {
          @Override
          @RefIgnore
          public double applyAsDouble(Map.Entry<CharSequence, MonitoringWrapperLayer> x) {
            MonitoringWrapperLayer temp_13_0019 = x.getValue();
            double temp_13_0002 = -temp_13_0019.getForwardPerformance().getMean();
            temp_13_0019.freeRef();
            RefUtil.freeRef(x);
            return temp_13_0002;
          }
        })).map(e -> {
          MonitoringWrapperLayer temp_13_0020 = e.getValue();
          @Nonnull final PercentileStatistics performanceF = temp_13_0020.getForwardPerformance();
          temp_13_0020.freeRef();
          MonitoringWrapperLayer temp_13_0021 = e.getValue();
          @Nonnull final PercentileStatistics performanceB = temp_13_0021.getBackwardPerformance();
          temp_13_0021.freeRef();
          String temp_13_0003 = RefString.format("%.6fs +- %.6fs (%d) <- %s", performanceF.getMean(),
              performanceF.getStdDev(), performanceF.getCount(), e.getKey())
              + (performanceB.getCount() == 0 ? ""
              : RefString.format("%n\tBack: %.6fs +- %.6fs (%s)", performanceB.getMean(), performanceB.getStdDev(),
              performanceB.getCount()));
          RefUtil.freeRef(e);
          return temp_13_0003;
        }).reduce((a, b) -> a + "\n\t" + b), "-"));
    temp_13_0018.freeRef();
    metrics.freeRef();
Logging
Performance: 
0.020213s +- 0.000994s (5) <- ImgTileSubnetLayer class=com.simiacryptus.mindseye.layers.cudnn.ImgTileSubnetLayer
Back: 0.052291s +- 0.003261s (5)
0.010326s +- 0.000221s (5) <- SimpleConvolutionLayer class=com.simiacryptus.mindseye.layers.cudnn.conv.SimpleConvolutionLayer
Back: 0.050345s +- 0.002963s (5)
0.001296s +- 0.000398s (5) <- ImgConcatLayer class=com.simiacryptus.mindseye.layers.cudnn.ImgConcatLayer
Back: 0.003912s +- 0.001885s (5)
0.000622s +- 0.000255s (5) <- ImgZeroPaddingLayer class=com.simiacryptus.mindseye.layers.cudnn.ImgZeroPaddingLayer
Back: 0.001712s +- 0.001938s (5)

LayerTests.java:425 executed in 0.00 seconds (0.000 gc):

    throwException(exceptions.addRef());

Results

classresult
com.simiacryptus.mindseye.test.unit.PerformanceTesterOK
  {
    "result": "OK",
    "performance": {
      "execution_time": "1.647",
      "gc_time": "0.220"
    },
    "created_on": 1586747371470,
    "file_name": "perfTest",
    "report": {
      "simpleName": "IrregularTest",
      "canonicalName": "com.simiacryptus.mindseye.layers.cudnn.conv.ConvolutionLayerTest.IrregularTest",
      "link": "https://github.com/SimiaCryptus/mindseye-cudnn/tree/59d5b3318556370acb2d83ee6ec123ce0fc6974f/src/test/java/com/simiacryptus/mindseye/layers/cudnn/conv/ConvolutionLayerTest.java",
      "javaDoc": ""
    },
    "archive": "s3://code.simiacrypt.us/tests/com/simiacryptus/mindseye/layers/cudnn/conv/ConvolutionLayer/IrregularTest/perfTest/202004130931",
    "id": "4f0ad89a-b0e3-441c-91b0-d77fa131ae37",
    "report_type": "Components",
    "display_name": "Performance",
    "target": {
      "simpleName": "ConvolutionLayer",
      "canonicalName": "com.simiacryptus.mindseye.layers.cudnn.conv.ConvolutionLayer",
      "link": "https://github.com/SimiaCryptus/mindseye-cudnn/tree/59d5b3318556370acb2d83ee6ec123ce0fc6974f/src/main/java/com/simiacryptus/mindseye/layers/cudnn/conv/ConvolutionLayer.java",
      "javaDoc": ""
    }
  }