1. Test Modules
  2. Network Diagram
  3. Performance
  4. Results

Subreport: Logs for com.simiacryptus.ref.lang.ReferenceCountingBase

Test Modules

Network Diagram

This is a network apply the following layout:

LayerTests.java:203 executed in 0.08 seconds (0.000 gc):

    return Graphviz.fromGraph((Graph) TestUtil.toGraph(((DAGNetwork) layer).addRef())).height(400).width(600)
        .render(Format.PNG).toImage();
Logging
executing command [/bin/sh, -c, dot -Tsvg /tmp/GraphvizJava/DotEngine2744529669493206787/dotfile.dot -ooutfile.svg]

Returns

Result

Using Seed 6898294585291110400

Performance

Now we execute larger-scale runs to benchmark performance:

PerformanceTester.java:120 executed in 2.54 seconds (0.089 gc):

    test(component == null ? null : component.addRef(), RefUtil.addRef(inputPrototype));
Logging
2 batch length, 5 trials
Input Dimensions:
[600, 600, 4]
Performance:
Evaluation performance: 0.042986s +- 0.005508s [0.037141s - 0.053095s]
Learning performance: 0.465090s +- 0.052234s [0.412145s - 0.541000s]

Per-key Performance Metrics:

TestUtil.java:185 executed in 0.00 seconds (0.000 gc):

    @Nonnull final RefMap<CharSequence, MonitoringWrapperLayer> metrics = new RefHashMap<>();
    network.visitNodes(RefUtil.wrapInterface(node -> {
      Layer nodeLayer = node.getLayer();
      if (nodeLayer instanceof MonitoringWrapperLayer) {
        @Nullable final MonitoringWrapperLayer layer = (MonitoringWrapperLayer) nodeLayer.addRef();
        Layer inner = layer.getInner();
        assert inner != null;
        String str = inner.toString();
        str += " class=" + inner.getClass().getName();
        inner.freeRef();
        RefUtil.freeRef(metrics.put(str, layer.addRef()));
        layer.freeRef();
      }
      assert nodeLayer != null;
      nodeLayer.freeRef();
      node.freeRef();
    }, metrics.addRef()));
    RefSet<Map.Entry<CharSequence, MonitoringWrapperLayer>> temp_13_0018 = metrics.entrySet();
    TestUtil.logger.info("Performance: \n\t" + RefUtil.orElse(temp_13_0018.stream()
        .sorted(RefComparator.comparingDouble(new ToDoubleFunction<Map.Entry<CharSequence, MonitoringWrapperLayer>>() {
          @Override
          @RefIgnore
          public double applyAsDouble(Map.Entry<CharSequence, MonitoringWrapperLayer> x) {
            MonitoringWrapperLayer temp_13_0019 = x.getValue();
            double temp_13_0002 = -temp_13_0019.getForwardPerformance().getMean();
            temp_13_0019.freeRef();
            RefUtil.freeRef(x);
            return temp_13_0002;
          }
        })).map(e -> {
          MonitoringWrapperLayer temp_13_0020 = e.getValue();
          @Nonnull final PercentileStatistics performanceF = temp_13_0020.getForwardPerformance();
          temp_13_0020.freeRef();
          MonitoringWrapperLayer temp_13_0021 = e.getValue();
          @Nonnull final PercentileStatistics performanceB = temp_13_0021.getBackwardPerformance();
          temp_13_0021.freeRef();
          String temp_13_0003 = RefString.format("%.6fs +- %.6fs (%d) <- %s", performanceF.getMean(),
              performanceF.getStdDev(), performanceF.getCount(), e.getKey())
              + (performanceB.getCount() == 0 ? ""
              : RefString.format("%n\tBack: %.6fs +- %.6fs (%s)", performanceB.getMean(), performanceB.getStdDev(),
              performanceB.getCount()));
          RefUtil.freeRef(e);
          return temp_13_0003;
        }).reduce((a, b) -> a + "\n\t" + b), "-"));
    temp_13_0018.freeRef();
    metrics.freeRef();
Logging
Performance: 
0.041373s +- 0.003873s (5) <- ImgLinearSubnetLayer class=com.simiacryptus.mindseye.layers.cudnn.ImgLinearSubnetLayer
Back: 0.180311s +- 0.001957s (5)

LayerTests.java:425 executed in 0.00 seconds (0.000 gc):

    throwException(exceptions.addRef());

Results

classresult
com.simiacryptus.mindseye.test.unit.PerformanceTesterOK
  {
    "result": "OK",
    "performance": {
      "execution_time": "2.986",
      "gc_time": "0.298"
    },
    "created_on": 1586748352449,
    "file_name": "perfTest",
    "report": {
      "simpleName": "SqGrid",
      "canonicalName": "com.simiacryptus.mindseye.layers.cudnn.conv.ConvolutionLayerTest.SqGrid",
      "link": "https://github.com/SimiaCryptus/mindseye-cudnn/tree/59d5b3318556370acb2d83ee6ec123ce0fc6974f/src/test/java/com/simiacryptus/mindseye/layers/cudnn/conv/ConvolutionLayerTest.java",
      "javaDoc": ""
    },
    "archive": "s3://code.simiacrypt.us/tests/com/simiacryptus/mindseye/layers/cudnn/conv/ConvolutionLayer/SqGrid/perfTest/202004132552",
    "id": "cdcce2c9-4573-4558-9a6d-3de0047e9095",
    "report_type": "Components",
    "display_name": "Performance",
    "target": {
      "simpleName": "ConvolutionLayer",
      "canonicalName": "com.simiacryptus.mindseye.layers.cudnn.conv.ConvolutionLayer",
      "link": "https://github.com/SimiaCryptus/mindseye-cudnn/tree/59d5b3318556370acb2d83ee6ec123ce0fc6974f/src/main/java/com/simiacryptus/mindseye/layers/cudnn/conv/ConvolutionLayer.java",
      "javaDoc": ""
    }
  }