Neural network fallback to CPU using NNAPI on Android

KrockS · February 15, 2022, 9:37am

Hello!
We are currently trying launch neural network with NNAPI on android, however it always falls back on CPU. If we are launching it with hardcoded GPU it work fine.
Have someone experienced this issue? Any recommendations?
This is our device list:

Pixel 6
Oppo Reno 5 Pro
Samsung Galaxy s10e
Xiaomi Redmi Note 10 5G
Microsoft Surface Duo
Samsung Galaxy Note 10+
Google Pixel 3XL
Samsung galaxy S21
Samsung galaxy S21+
Xiaomi MI 8
Google Pixel 4XL

Bhack · February 15, 2022, 11:03am

Have you checked if your model has supported NNAPI ops:

Seany · February 16, 2022, 3:51am

// ***********************
// support for NNAPI operations improved significantly for Android API Level 28 (Android Pie) onwards,
// and it is recommended that developers use the NNAPI delegate for Android Pie,
// or above for most scenarios
// ***********************

import org.tensorflow.lite.Interpreter;
import org.tensorflow.lite.nnapi.NnApiDelegate;

Interpreter.Options options = (new Interpreter.Options());
NnApiDelegate nnApiDelegate = null;
// Initialize interpreter with NNAPI delegate for Android Pie or above
if(Build.VERSION.SDK_INT >= Build.VERSION_CODES.P) {
nnApiDelegate = new NnApiDelegate();
options.addDelegate(nnApiDelegate);
}

// Initialize TFLite interpreter
try {
tfLite = new Interpreter(loadModelFile(assetManager, modelFilename), options);
} catch (Exception e) {
throw new RuntimeException(e);
}

// Run inference
// …

// Unload delegate
tfLite.close();
if(null != nnApiDelegate) {
nnApiDelegate.close();
}

KrockS · February 17, 2022, 9:26am

Thank you, i’ve confirmed it with our data science team, we are using supported NNAPI ops. We have also tried Resnet with same result. We also created test app for testing purpose.
Maybe there are some other ideas?

KrockS · February 17, 2022, 9:45am

We also have opportunity to change delegate (CPU, GPU, NNAPI) on the flight in test app, and table of benchmark.
Android NN perfomance for tensorflow forum - Google Sheets spreadsheet with metrics, i’ve added pic with test app to second page, we are running NN 100 times and counting avg.
Our problem is not that we are not able to run it, but that NNAPI performance is not as high as expected and we CPU fallback. Would be grateful for any ideas.

Bhack · February 17, 2022, 11:03am

Have you tried to benchmark it with TFlite tool with the different NNAPI parameters It has?

KrockS · February 17, 2022, 2:05pm

We tried it. Here is output.

NNAPI

STARTING!
Log parameter values verbosely: [0]
Graph: [/data/local/tmp/android_segmenter_3ch.tflite]
Enable op profiling: [1]
Use NNAPI: [1]
NNAPI accelerators available: [eden-drv,nnapi-reference]
Use xnnpack: [0]
Loaded model /data/local/tmp/android_segmenter_3ch.tflite
INFO: Initialized TensorFlow Lite runtime.
NNAPI delegate created.
INFO: Created TensorFlow Lite delegate for NNAPI.
Though NNAPI delegate is explicitly applied, the model graph will not be executed by the delegate.
The input model file size (MB): 6.35428
Initialized session in 34.939ms.
Running benchmark for at least 1 iterations and at least 0.5 seconds but terminate if exceeding 150 seconds.
count=5 first=130492 curr=111222 min=111222 max=130492 avg=116523 std=7192

Running benchmark for at least 50 iterations and at least 1 seconds but terminate if exceeding 150 seconds.
count=50 first=112256 curr=111087 min=110425 max=114213 avg=112533 std=778

Inference timings in us: Init: 34939, First inference: 130492, Warmup (avg): 116523, Inference (avg): 112533
Note: as the benchmark tool itself affects memory footprint, the following is only APPROXIMATE to the actual memory footprint of the model at runtime. Take the information at your discretion.
Memory footprint delta from the start of the tool (MB): init=6.70312 overall=63.4023
Profiling Info for Benchmark Initialization:
============================== Run Order ==============================
[node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name]
ModifyGraphWithDelegate 0.000 30.388 30.388 99.016% 99.016% 2216.000 1 ModifyGraphWithDelegate/0
AllocateTensors 30.284 0.298 0.151 0.984% 100.000% 0.000 2 AllocateTensors/0

============================== Top by Computation Time ==============================
[node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name]
ModifyGraphWithDelegate 0.000 30.388 30.388 99.016% 99.016% 2216.000 1 ModifyGraphWithDelegate/0
AllocateTensors 30.284 0.298 0.151 0.984% 100.000% 0.000 2 AllocateTensors/0

Number of nodes executed: 2
============================== Summary by node type ==============================
[Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called]
ModifyGraphWithDelegate 1 30.388 99.016% 99.016% 2216.000 1
AllocateTensors 1 0.302 0.984% 100.000% 0.000 2

Timings (microseconds): count=1 curr=30690
Memory (bytes): count=0
2 nodes observed

Operator-wise ============================== [node type] PAD 0.005 CONV_2D 0.140 DEPTHWISE_CONV_2D CONV_2D 5.406 ADD 6.587 CONV_2D 6.991 PAD 10.070 DEPTHWISE_CONV_2D CONV_2D 14.163 CONV_2D 15.376 DEPTHWISE_CONV_2D CONV_2D 18.919 ADD 20.295 CONV_2D 20.469 PAD 21.621 DEPTHWISE_CONV_2D CONV_2D 22.486 CONV_2D 22.982 DEPTHWISE_CONV_2D CONV_2D 24.496 ADD 25.292 CONV_2D 25.336 DEPTHWISE_CONV_2D CONV_2D 26.878 ADD 27.659 CONV_2D 27.700 PAD 29.048 DEPTHWISE_CONV_2D CONV_2D 29.701 CONV_2D 30.408 DEPTHWISE_CONV_2D CONV_2D 31.292 ADD 31.894 CONV_2D 31.917 DEPTHWISE_CONV_2D CONV_2D 32.713 ADD 33.247 CONV_2D 33.270 DEPTHWISE_CONV_2D CONV_2D 34.071 ADD 34.608 CONV_2D 34.632 DEPTHWISE_CONV_2D CONV_2D 36.681 CONV_2D 38.682 DEPTHWISE_CONV_2D CONV_2D 42.269 ADD 45.096 CONV_2D 45.138 PAD 47.612 DEPTHWISE_CONV_2D CONV_2D 48.150 CONV_2D 49.217 DEPTHWISE_CONV_2D CONV_2D 50.927 ADD 52.393 CONV_2D 52.406 DEPTHWISE_CONV_2D CONV_2D 54.091 ADD 55.520 CONV_2D 55.531 DEPTHWISE_CONV_2D CONV_2D 57.216 RESIZE_NEAREST_NEIGHBOR DEPTHWISE_CONV_2D CONV_2D 58.438 DEPTHWISE_CONV_2D CONV_2D 59.087 ADD 59.541 RESIZE_NEAREST_NEIGHBOR DEPTHWISE_CONV_2D CONV_2D 60.419 DEPTHWISE_CONV_2D CONV_2D 62.569 ADD 63.222 DEPTHWISE_CONV_2D CONV_2D 64.120 RESIZE_NEAREST_NEIGHBOR DEPTHWISE_CONV_2D CONV_2D 67.767 RESIZE_NEAREST_NEIGHBOR DEPTHWISE_CONV_2D CONV_2D 77.361 RESIZE_NEAREST_NEIGHBOR DEPTHWISE_CONV_2D CONV_2D 100.196 SOFTMAX 105.314 Profiling Info for Regular Benchmark Runs:
Run Order ==============================
[start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name]
0.150 0.133 0.119% 0.119% 0.000 1 [model/sequential/zero_padding2d/Pad]:0
3.266 3.256 2.894% 3.013% 0.000 1 [model/re_lu/Relu;model/batch_normalization/FusedBatchNormV3;model/batch_normalization_1/FusedBatchNormV3;model/depthwise_conv2d/depthwise;model/conv2d_1/Conv2D;model/sequential/conv2d/Conv2D]:1
3.396 1.990 2.009 1.786% 4.799% 0.000 1 [model/re_lu_1/Relu;model/batch_normalization_1/FusedBatchNormV3;model/depthwise_conv2d/depthwise;model/conv2d_1/Conv2D]:2
1.173 1.181 1.050% 5.849% 0.000 1 [model/batch_normalization_2/FusedBatchNormV3;model/conv2d_1/Conv2D1]:3
0.422 0.403 0.359% 6.208% 0.000 1 [model/tf.math.add/Add]:4
3.037 3.078 2.737% 8.945% 0.000 1 [model/re_lu_2/Relu;model/batch_normalization_3/FusedBatchNormV3;model/batch_normalization_4/FusedBatchNormV3;model/sequential_1/depthwise_conv2d_1/depthwise;model/conv2d_2/Conv2D]:5
1.218 1.171 1.041% 9.986% 0.000 1 [model/sequential_1/zero_padding2d_1/Pad]:6
11.242 2.945 2.920 2.596% 12.582% 0.000 1 [model/re_lu_3/Relu;model/batch_normalization_4/FusedBatchNormV3;model/sequential_1/depthwise_conv2d_1/depthwise]:7
1.228 1.212 1.078% 13.660% 0.000 1 [model/batch_normalization_5/FusedBatchNormV3;model/depthwise_conv2d_23/depthwise;model/conv2d_3/Conv2D1]:8
1.171 1.173 1.043% 14.703% 0.000 1 [model/re_lu_4/Relu;model/batch_normalization_6/FusedBatchNormV3;model/batch_normalization_10/FusedBatchNormV3;model/sequential_2/depthwise_conv2d_3/depthwise;model/depthwise_conv2d_21/depthwise;model/conv2d_4/Conv2D]:9
16.549 2.381 2.369 2.106% 16.809% 0.000 1 [model/re_lu_5/Relu;model/batch_normalization_7/FusedBatchNormV3;model/batch_normalization_10/FusedBatchNormV3;model/sequential_2/depthwise_conv2d_3/depthwise;model/depthwise_conv2d_21/depthwise;model/depthwise_conv2d_2/depthwise]:10
1.364 1.375 1.223% 18.032% 0.000 1 [model/batch_normalization_8/FusedBatchNormV3;model/depthwise_conv2d_23/depthwise;model/conv2d_5/Conv2D1]:11
0.171 0.173 0.154% 18.186% 0.000 1 [model/tf.math.add_1/Add]:12
1.146 1.152 1.025% 19.210% 0.000 1 [model/re_lu_6/Relu;model/batch_normalization_9/FusedBatchNormV3;model/batch_normalization_10/FusedBatchNormV3;model/sequential_2/depthwise_conv2d_3/depthwise;model/depthwise_conv2d_21/depthwise;model/conv2d_6/Conv2D]:13
0.268 0.275 0.245% 19.455% 0.000 1 [model/sequential_2/zero_padding2d_2/Pad]:14
21.897 0.571 0.589 0.523% 19.978% 0.000 1 [model/re_lu_7/Relu;model/batch_normalization_10/FusedBatchNormV3;model/sequential_2/depthwise_conv2d_3/depthwise;model/depthwise_conv2d_21/depthwise]:15
0.519 0.496 0.441% 20.419% 0.000 1 [model/batch_normalization_11/FusedBatchNormV3;model/depthwise_conv2d_19/depthwise;model/conv2d_7/Conv2D1]:16
0.716 0.710 0.631% 21.050% 0.000 1 [model/re_lu_8/Relu;model/batch_normalization_12/FusedBatchNormV3;model/batch_normalization_16/FusedBatchNormV3;model/depthwise_conv2d_5/depthwise;model/conv2d_8/Conv2D]:17
23.692 0.689 0.803 0.714% 21.764% 0.000 1 [model/re_lu_9/Relu;model/batch_normalization_13/FusedBatchNormV3;model/batch_normalization_16/FusedBatchNormV3;model/depthwise_conv2d_5/depthwise;model/depthwise_conv2d_4/depthwise]:18
0.792 0.796 0.707% 22.471% 0.000 1 [model/batch_normalization_14/FusedBatchNormV3;model/depthwise_conv2d_19/depthwise;model/conv2d_9/Conv2D1]:19
0.049 0.044 0.039% 22.510% 0.000 1 [model/tf.math.add_2/Add]:20
0.705 0.706 0.628% 23.138% 0.000 1 [model/re_lu_10/Relu;model/batch_normalization_15/FusedBatchNormV3;model/batch_normalization_16/FusedBatchNormV3;model/depthwise_conv2d_5/depthwise;model/conv2d_10/Conv2D]:21
26.042 0.735 0.835 0.742% 23.881% 0.000 1 [model/re_lu_11/Relu;model/batch_normalization_16/FusedBatchNormV3;model/depthwise_conv2d_5/depthwise]:22
0.786 0.781 0.694% 24.575% 0.000 1 [model/batch_normalization_17/FusedBatchNormV3;model/depthwise_conv2d_19/depthwise;model/conv2d_11/Conv2D1]:23
0.044 0.040 0.036% 24.611% 0.000 1 [model/tf.math.add_3/Add]:24
1.350 1.347 1.198% 25.809% 0.000 1 [model/re_lu_12/Relu;model/batch_normalization_18/FusedBatchNormV3;model/batch_normalization_19/FusedBatchNormV3;model/sequential_3/depthwise_conv2d_6/depthwise;model/conv2d_12/Conv2D]:25
0.217 0.185 0.165% 25.973% 0.000 1 [model/sequential_3/zero_padding2d_3/Pad]:26
29.233 0.492 0.467 0.415% 26.389% 0.000 1 [model/re_lu_13/Relu;model/batch_normalization_19/FusedBatchNormV3;model/sequential_3/depthwise_conv2d_6/depthwise]:27
0.709 0.707 0.628% 27.017% 0.000 1 [model/batch_normalization_20/FusedBatchNormV3;model/conv2d_19/Conv2D;model/conv2d_13/Conv2D1]:28
0.581 0.553 0.492% 27.509% 0.000 1 [model/re_lu_14/Relu;model/batch_normalization_21/FusedBatchNormV3;model/batch_normalization_22/FusedBatchNormV3;model/depthwise_conv2d_7/depthwise;model/conv2d_14/Conv2D]:29
30.962 0.303 0.330 0.294% 27.803% 0.000 1 [model/re_lu_15/Relu;model/batch_normalization_22/FusedBatchNormV3;model/depthwise_conv2d_7/depthwise]:30
0.610 0.602 0.535% 28.338% 0.000 1 [model/batch_normalization_23/FusedBatchNormV3;model/conv2d_19/Conv2D;model/conv2d_15/Conv2D1]:31
0.022 0.022 0.020% 28.358% 0.000 1 [model/tf.math.add_4/Add]:32
0.509 0.514 0.457% 28.815% 0.000 1 [model/re_lu_16/Relu;model/batch_normalization_24/FusedBatchNormV3;model/batch_normalization_28/FusedBatchNormV3;model/depthwise_conv2d_9/depthwise;model/conv2d_16/Conv2D]:33
32.431 0.285 0.282 0.251% 29.065% 0.000 1 [model/re_lu_17/Relu;model/batch_normalization_25/FusedBatchNormV3;model/batch_normalization_28/FusedBatchNormV3;model/depthwise_conv2d_9/depthwise;model/depthwise_conv2d_8/depthwise]:34
0.538 0.534 0.474% 29.540% 0.000 1 [model/batch_normalization_26/FusedBatchNormV3;model/conv2d_19/Conv2D;model/conv2d_17/Conv2D1]:35
0.021 0.022 0.020% 29.559% 0.000 1 [model/tf.math.add_5/Add]:36
0.526 0.521 0.463% 30.022% 0.000 1 [model/re_lu_18/Relu;model/batch_normalization_27/FusedBatchNormV3;model/batch_normalization_28/FusedBatchNormV3;model/depthwise_conv2d_9/depthwise;model/conv2d_18/Conv2D]:37
33.791 0.294 0.280 0.249% 30.271% 0.000 1 [model/re_lu_19/Relu;model/batch_normalization_28/FusedBatchNormV3;model/depthwise_conv2d_9/depthwise]:38
0.546 0.537 0.478% 30.749% 0.000 1 [model/batch_normalization_29/FusedBatchNormV3;model/conv2d_19/Conv2D1]:39
0.023 0.023 0.021% 30.769% 0.000 1 [model/tf.math.add_6/Add]:40
1.284 1.270 1.129% 31.898% 0.000 1 [model/re_lu_20/Relu;model/batch_normalization_30/FusedBatchNormV3;model/batch_normalization_31/FusedBatchNormV3;model/depthwise_conv2d_10/depthwise;model/conv2d_20/Conv2D]:41
35.902 0.807 0.778 0.692% 32.590% 0.000 1 [model/re_lu_21/Relu;model/batch_normalization_31/FusedBatchNormV3;model/depthwise_conv2d_10/depthwise]:42
1.888 2.001 1.779% 34.369% 0.000 1 [model/batch_normalization_32/FusedBatchNormV3;model/depthwise_conv2d_20/depthwise;model/conv2d_21/Conv2D1]:43
2.474 2.469 2.195% 36.564% 0.000 1 [model/re_lu_22/Relu;model/batch_normalization_33/FusedBatchNormV3;model/batch_normalization_37/FusedBatchNormV3;model/sequential_4/depthwise_conv2d_12/depthwise;model/conv2d_22/Conv2D]:44
41.152 1.040 1.117 0.993% 37.557% 0.000 1 [model/re_lu_23/Relu;model/batch_normalization_34/FusedBatchNormV3;model/batch_normalization_37/FusedBatchNormV3;model/sequential_4/depthwise_conv2d_12/depthwise;model/depthwise_conv2d_11/depthwise]:45
2.785 2.827 2.513% 40.070% 0.000 1 [model/batch_normalization_35/FusedBatchNormV3;model/depthwise_conv2d_20/depthwise;model/conv2d_23/Conv2D1]:46
0.044 0.042 0.037% 40.107% 0.000 1 [model/tf.math.add_7/Add]:47
2.477 2.474 2.200% 42.307% 0.000 1 [model/re_lu_24/Relu;model/batch_normalization_36/FusedBatchNormV3;model/batch_normalization_37/FusedBatchNormV3;model/sequential_4/depthwise_conv2d_12/depthwise;model/conv2d_24/Conv2D]:48
0.204 0.184 0.164% 42.470% 0.000 1 [model/sequential_4/zero_padding2d_4/Pad]:49
47.797 0.368 0.353 0.314% 42.784% 0.000 1 [model/re_lu_25/Relu;model/batch_normalization_37/FusedBatchNormV3;model/sequential_4/depthwise_conv2d_12/depthwise]:50
1.051 1.067 0.948% 43.732% 0.000 1 [model/batch_normalization_38/FusedBatchNormV3;model/conv2d_29/Conv2D;model/conv2d_25/Conv2D1]:51
1.328 1.337 1.188% 44.921% 0.000 1 [model/re_lu_26/Relu;model/batch_normalization_39/FusedBatchNormV3;model/batch_normalization_43/FusedBatchNormV3;model/depthwise_conv2d_14/depthwise;model/depthwise_conv2d_15/depthwise;model/conv2d_26/Conv2D]:52
50.554 0.384 0.372 0.331% 45.252% 0.000 1 [model/re_lu_27/Relu;model/batch_normalization_40/FusedBatchNormV3;model/batch_normalization_43/FusedBatchNormV3;model/depthwise_conv2d_14/depthwise;model/depthwise_conv2d_15/depthwise;model/depthwise_conv2d_13/depthwise]:53
1.452 1.465 1.303% 46.554% 0.000 1 [model/batch_normalization_41/FusedBatchNormV3;model/conv2d_29/Conv2D;model/conv2d_27/Conv2D1]:54
0.012 0.012 0.011% 46.566% 0.000 1 [model/tf.math.add_8/Add]:55
1.323 1.331 1.184% 47.749% 0.000 1 [model/re_lu_28/Relu;model/batch_normalization_42/FusedBatchNormV3;model/batch_normalization_43/FusedBatchNormV3;model/depthwise_conv2d_14/depthwise;model/depthwise_conv2d_15/depthwise;model/conv2d_28/Conv2D]:56
53.737 0.361 0.353 0.314% 48.063% 0.000 1 [model/re_lu_29/Relu;model/batch_normalization_43/FusedBatchNormV3;model/depthwise_conv2d_14/depthwise;model/depthwise_conv2d_15/depthwise]:57
1.415 1.429 1.270% 49.333% 0.000 1 [model/batch_normalization_44/FusedBatchNormV3;model/conv2d_29/Conv2D1]:58
0.012 0.011 0.010% 49.343% 0.000 1 [model/tf.math.add_9/Add]:59
1.328 1.328 1.181% 50.524% 0.000 1 [model/re_lu_30/Relu;model/batch_normalization_45/FusedBatchNormV3;model/batch_normalization_43/FusedBatchNormV3;model/depthwise_conv2d_14/depthwise;model/depthwise_conv2d_15/depthwise;model/conv2d_30/Conv2D]:60
56.860 0.357 0.356 0.317% 50.840% 0.000 1 [model/depthwise_conv2d_15/depthwise1]:61
1.030 1.011 0.899% 51.740% 0.000 1 [model/re_lu_31/Relu;model/batch_normalization_46/FusedBatchNormV3;model/depthwise_conv2d_20/depthwise;model/conv2d_31/Conv2D]:62
58.228 0.019 0.018 0.016% 51.755% 0.000 1 [model/up_sampling2d/resize/ResizeNearestNeighbor]:63
58.246 0.191 0.191 0.170% 51.925% 0.000 1 [model/depthwise_conv2d_16/depthwise1]:64
0.472 0.458 0.407% 52.333% 0.000 1 [model/re_lu_32/Relu;model/batch_normalization_47/FusedBatchNormV3;model/depthwise_conv2d_20/depthwise;model/conv2d_32/Conv2D]:65
58.896 0.177 0.191 0.170% 52.503% 0.000 1 [model/depthwise_conv2d_17/depthwise1]:66
0.439 0.454 0.403% 52.906% 0.000 1 [model/re_lu_33/Relu;model/batch_normalization_48/FusedBatchNormV3;model/depthwise_conv2d_20/depthwise;model/conv2d_33/Conv2D]:67
0.031 0.030 0.027% 52.933% 0.000 1 [model/tf.math.add_10/Add]:68
59.572 0.061 0.061 0.055% 52.988% 0.000 1 [model/up_sampling2d_1/resize/ResizeNearestNeighbor]:69
59.633 0.797 0.785 0.698% 53.686% 0.000 1 [model/depthwise_conv2d_18/depthwise1]:70
1.807 1.794 1.595% 55.281% 0.000 1 [model/re_lu_34/Relu;model/batch_normalization_49/FusedBatchNormV3;model/depthwise_conv2d_20/depthwise;model/conv2d_34/Conv2D]:71
62.213 0.368 0.355 0.316% 55.596% 0.000 1 [model/depthwise_conv2d_19/depthwise2]:72
0.665 0.653 0.580% 56.177% 0.000 1 [model/re_lu_35/Relu;model/batch_normalization_50/FusedBatchNormV3;model/depthwise_conv2d_20/depthwise;model/conv2d_35/Conv2D]:73
0.110 0.109 0.097% 56.274% 0.000 1 [model/tf.math.add_11/Add]:74
63.332 0.673 0.788 0.701% 56.975% 0.000 1 [model/depthwise_conv2d_20/depthwise2]:75
1.168 1.169 1.039% 58.014% 0.000 1 [model/re_lu_36/Relu;model/batch_normalization_51/FusedBatchNormV3;model/batch_normalization_10/FusedBatchNormV3;model/sequential_2/depthwise_conv2d_3/depthwise;model/depthwise_conv2d_21/depthwise;model/conv2d_36/Conv2D]:76
65.290 0.335 0.318 0.283% 58.297% 0.000 1 [model/up_sampling2d_2/resize/ResizeNearestNeighbor]:77
65.609 2.184 2.158 1.919% 60.216% 0.000 1 [model/depthwise_conv2d_21/depthwise1]:78
2.271 2.284 2.031% 62.247% 0.000 1 [model/re_lu_37/Relu;model/batch_normalization_52/FusedBatchNormV3;model/depthwise_conv2d_22/depthwise;model/conv2d_37/Conv2D]:79
70.052 0.735 0.738 0.656% 62.903% 0.000 1 [model/up_sampling2d_3/resize/ResizeNearestNeighbor]:80
70.791 6.391 6.568 5.840% 68.742% 0.000 1 [model/depthwise_conv2d_22/depthwise2]:81
3.830 3.837 3.412% 72.154% 0.000 1 [model/re_lu_38/Relu;model/batch_normalization_53/FusedBatchNormV3;model/depthwise_conv2d_23/depthwise;model/conv2d_38/Conv2D]:82
81.199 1.524 1.534 1.364% 73.518% 0.000 1 [model/up_sampling2d_4/resize/ResizeNearestNeighbor]:83
82.734 17.310 17.460 15.523% 89.041% 0.000 1 [model/depthwise_conv2d_23/depthwise2]:84
5.083 5.117 4.549% 93.590% 0.000 1 [model/conv2d_39/BiasAdd;model/conv2d_39/Conv2D;conv2d_39/bias1]:85
7.563 7.210 6.410% 100.000% 0.000 1 [StatefulPartitionedCall:0]:86

============================== Top by Computation Time ==============================
[node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name]
DEPTHWISE_CONV_2D 82.734 17.310 17.460 15.523% 15.523% 0.000 1 [model/depthwise_conv2d_23/depthwise2]:84
SOFTMAX 105.314 7.563 7.210 6.410% 21.933% 0.000 1 [StatefulPartitionedCall:0]:86
DEPTHWISE_CONV_2D 70.791 6.391 6.568 5.840% 27.772% 0.000 1 [model/depthwise_conv2d_22/depthwise2]:81
CONV_2D 100.196 5.083 5.117 4.549% 32.322% 0.000 1 [model/conv2d_39/BiasAdd;model/conv2d_39/Conv2D;conv2d_39/bias1]:85
CONV_2D 77.361 3.830 3.837 3.412% 35.733% 0.000 1 [model/re_lu_38/Relu;model/batch_normalization_53/FusedBatchNormV3;model/depthwise_conv2d_23/depthwise;model/conv2d_38/Conv2D]:82
CONV_2D 0.140 3.266 3.256 2.894% 38.628% 0.000 1 [model/re_lu/Relu;model/batch_normalization/FusedBatchNormV3;model/batch_normalization_1/FusedBatchNormV3;model/depthwise_conv2d/depthwise;model/conv2d_1/Conv2D;model/sequential/conv2d/Conv2D]:1
CONV_2D 6.991 3.037 3.078 2.737% 41.364% 0.000 1 [model/re_lu_2/Relu;model/batch_normalization_3/FusedBatchNormV3;model/batch_normalization_4/FusedBatchNormV3;model/sequential_1/depthwise_conv2d_1/depthwise;model/conv2d_2/Conv2D]:5
DEPTHWISE_CONV_2D 11.242 2.945 2.920 2.596% 43.961% 0.000 1 [model/re_lu_3/Relu;model/batch_normalization_4/FusedBatchNormV3;model/sequential_1/depthwise_conv2d_1/depthwise]:7
CONV_2D 42.269 2.785 2.827 2.513% 46.474% 0.000 1 [model/batch_normalization_35/FusedBatchNormV3;model/depthwise_conv2d_20/depthwise;model/conv2d_23/Conv2D1]:46
CONV_2D 45.138 2.477 2.474 2.200% 48.673% 0.000 1 [model/re_lu_24/Relu;model/batch_normalization_36/FusedBatchNormV3;model/batch_normalization_37/FusedBatchNormV3;model/sequential_4/depthwise_conv2d_12/depthwise;model/conv2d_24/Conv2D]:48

Number of nodes executed: 87
============================== Summary by node type ==============================
[Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called]
CONV_2D 40 56.985 50.682% 50.682% 0.000 40
DEPTHWISE_CONV_2D 24 42.700 37.977% 88.659% 0.000 24
SOFTMAX 1 7.209 6.412% 95.070% 0.000 1
RESIZE_NEAREST_NEIGHBOR 5 2.667 2.372% 97.442% 0.000 5
PAD 5 1.948 1.733% 99.175% 0.000 5
ADD 12 0.928 0.825% 100.000% 0.000 12

Timings (microseconds): count=50 first=112190 curr=111029 min=110364 max=114134 avg=112478 std=778
Memory (bytes): count=0
87 nodes observed

GPU

STARTING!
Log parameter values verbosely: [0]
Graph: [/data/local/tmp/android_segmenter_3ch.tflite]
Enable op profiling: [1]
Use gpu: [1]
Loaded model /data/local/tmp/android_segmenter_3ch.tflite
INFO: Initialized TensorFlow Lite runtime.
INFO: Created TensorFlow Lite delegate for GPU.
GPU delegate created.
INFO: Replacing 87 node(s) with delegate (TfLiteGpuDelegateV2) node, yielding 1 partitions.
INFO: Initialized OpenCL-based API.
Explicitly applied GPU delegate, and the model graph will be completely executed by the delegate.
The input model file size (MB): 6.35428
Initialized session in 493.147ms.
INFO: Created 1 GPU delegate kernels.
Running benchmark for at least 1 iterations and at least 0.5 seconds but terminate if exceeding 150 seconds.
count=31 first=49690 curr=16335 min=12114 max=49690 avg=15935.1 std=6269

Running benchmark for at least 50 iterations and at least 1 seconds but terminate if exceeding 150 seconds.
count=59 first=16829 curr=16825 min=15340 max=18993 avg=16181.1 std=539

Inference timings in us: Init: 493147, First inference: 49690, Warmup (avg): 15935.1, Inference (avg): 16181.1
Note: as the benchmark tool itself affects memory footprint, the following is only APPROXIMATE to the actual memory footprint of the model at runtime. Take the information at your discretion.
Memory footprint delta from the start of the tool (MB): init=105.855 overall=114.68
Profiling Info for Benchmark Initialization:
============================== Run Order ==============================
[node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name]
ModifyGraphWithDelegate 0.000 488.305 488.305 99.987% 99.987% 104548.000 1 ModifyGraphWithDelegate/0
AllocateTensors 488.283 0.061 0.031 0.013% 100.000% 0.000 2 AllocateTensors/0

============================== Top by Computation Time ==============================
[node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name]
ModifyGraphWithDelegate 0.000 488.305 488.305 99.987% 99.987% 104548.000 1 ModifyGraphWithDelegate/0
AllocateTensors 488.283 0.061 0.031 0.013% 100.000% 0.000 2 AllocateTensors/0

Number of nodes executed: 2
============================== Summary by node type ==============================
[Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called]
ModifyGraphWithDelegate 1 488.305 99.987% 99.987% 104548.000 1
AllocateTensors 1 0.062 0.013% 100.000% 0.000 2

Timings (microseconds): count=1 curr=488367
Memory (bytes): count=0
2 nodes observed

Operator-wise Profiling Info for Regular Benchmark Runs:
============================== Run Order ==============================
[node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name]
TfLiteGpuDelegateV2 0.032 16.734 16.100 100.000% 100.000% 0.000 1 [StatefulPartitionedCall:0]:87

============================== Top by Computation Time ==============================
[node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name]
TfLiteGpuDelegateV2 0.032 16.734 16.100 100.000% 100.000% 0.000 1 [StatefulPartitionedCall:0]:87

Number of nodes executed: 1
============================== Summary by node type ==============================
[Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called]
TfLiteGpuDelegateV2 1 16.100 100.000% 100.000% 0.000 1

Timings (microseconds): count=59 first=16734 curr=16749 min=15261 max=18911 avg=16100.1 std=540
Memory (bytes): count=0
1 nodes observed

Bhack · February 17, 2022, 7:57pm

I don’t know if this fix was also valid for NNAPI or it is still a false positive warning.

KrockS · February 22, 2022, 3:20pm

As far as i understood this is related to custom written delegate, but we are trying to launch default one.
Seems that with adding OpenCL and using alowStageLoss flag we have NNAPI working on Pixel 6 and float 16 architecture.

However still not on all devices and architectures.
Any suggestion anyone?

Bhack · February 22, 2022, 3:42pm

Have you tried to enable setUseNnapiCpu?

Bhack · February 22, 2022, 3:57pm

Also you could debug in the log the available ops for the specific device:

github.com/tensorflow/tensorflow

NNAPI on Kirin 980 NPU. Model won't run on NPU, libc : Access denied finding property "ro.hardware.chipname"

opened 02:28PM - 02 Nov 21 UTC

robert-hardwick

stat:awaiting tensorflower comp:lite type:performance 2.6.0

**System information** - Have I written custom code (as opposed to using a stoc…k example script provided in TensorFlow): - OS Platform and Distribution (e.g., Linux Ubuntu 16.04): 11.0 - Mobile device (e.g. iPhone 8, Pixel 2, Samsung Galaxy) if the issue happens on mobile device: Huawei P30 Pro - TensorFlow installed from (source or binary): android_aarch64_benchmark_tool - TensorFlow version (use command below): - Python version: - Bazel version (if compiling from source): - GCC/Compiler version (if compiling from source): - CUDA/cuDNN version: - GPU model and memory: I have been experiencing NNAPI producing longer inference times on my device than with standard CPU delegate, so i ran benchmark binary with tensorflow prebuilt NNAPI models. The debug from logcat shows that it get stuck with the following error ``` 11-02 14:18:11.933 29254 29254 E libc : Access denied finding property "ro.hardware.chipname" 11-02 14:18:11.928 29254 29254 W benchmark_model: type=1400 audit(0.0:752014): avc: denied { read } for pid=29254 name="u:object_r:vendor_default_prop:s0" dev="tmpfs" ino=15480 scontext=u:r:shell:s0 tcontext=u:object_r:vendor_default_prop:s0 tclass=file permissive=0 ``` I have tested this on Huawei P30 Pro and Huawei Nova 5T with the same results. I downloaded mobilenet_v1_1.0_224_quant.tflite NNAPI prebuilt model from here https://www.tensorflow.org/lite/performance/nnapi#use_supported_models_and_ops Then i pushed to the device and invoked the benchmarking tool .downloaded android aarch64 benchmark tool as per instructions and invoked the model like so ``` adb shell /data/local/tmp/benchmark_model \ --num_threads=4 \ --graph=/data/local/tmp/mobilenet_v1_1.0_224_quant.tflite \ --warmup_runs=1 \ --num_runs=50 --use_nnapi=1 --verbose=1 --disable_nnapi_cpu=0 --nnapi_accelerator_name="ipuadaptor" ``` I enabled verbose nnapi log using this command ```adb shell setprop debug.nn.vlog 1``` ``` 11-02 14:18:11.894 29254 29254 D skia : HME SkHmeDecFunction1 constructor ok 11-02 14:18:11.894 29254 29254 I HiTraceC: entered LogRegisterGetIdFun 11-02 14:18:11.894 29254 29254 I HiTraceC: entered HiTraceInit 11-02 14:18:11.896 29254 29254 I Manager : DeviceManager::DeviceManager 11-02 14:18:11.896 29254 29254 I Manager : findAvailableDevices 11-02 14:18:11.898 29254 29254 I Manager : Found interface ipuadaptor 11-02 14:18:11.903 1029 15537 I aiserver: IPUNNAdaptor getCapabilities_1_1 11-02 14:18:11.903 1029 15537 I aiserver: AiModelMngrService getCapabilities_1_1 11-02 14:18:11.903 1029 15537 I aiserver: AiModelMngrService getCapabilities 11-02 14:18:11.904 1029 15537 I hcs : AndroidNNMLUExecutor::GetCapabilities Get device capabilities success. 11-02 14:18:11.904 1029 15537 I AndroidNN: AnnHcsService::GetCapabilities(169)::"Get capabilities done!" 11-02 14:18:11.904 29254 29254 I Manager : Capab {.relaxedFloat32toFloat16PerformanceScalar = {.execTime = 0.470000, .powerUsage = 0.660000}, .relaxedFloat32toFloat16PerformanceTensor = {.execTime = 0.470000, .powerUsage = 0.660000}, .operandPerformance = [7]{{.type = FLOAT32, .info = {.execTime = 0.470000, .powerUsage = 0.660000}}, {.type = INT32, .info = {.execTime = 0.470000, .powerUsage = 0.250000}}, {.type = UINT32, .info = {.execTime = 0.470000, .powerUsage = 0.250000}}, {.type = TENSOR_FLOAT32, .info = {.execTime = 0.470000, .powerUsage = 0.660000}}, {.type = TENSOR_INT32, .info = {.execTime = 0.470000, .powerUsage = 0.250000}}, {.type = OEM, .info = {.execTime = 0.470000, .powerUsage = 0.250000}}, {.type = TENSOR_OEM_BYTE, .info = {.execTime = 0.470000, .powerUsage = 0.250000}}}} 11-02 14:18:11.905 29254 29254 I tflite : Initialized TensorFlow Lite runtime. 11-02 14:18:11.905 29254 29254 I tflite : Created TensorFlow Lite delegate for NNAPI. 11-02 14:18:11.906 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 1 offset 2405268 size 864 11-02 14:18:11.906 29254 29254 I TypeManager: TypeManager::TypeManager 11-02 14:18:11.906 29254 29254 I TypeManager: Failed to read /vendor/etc/nnapi_extensions_app_allowlist ; No app allowlisted for vendor extensions use. 11-02 14:18:11.906 29254 29254 I TypeManager: NNAPI Vendor extensions enabled: 0 11-02 14:18:11.906 29254 29254 I Memory : add() 11-02 14:18:11.906 29254 29254 I Memory : It's new 11-02 14:18:11.906 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 2 offset 4219296 size 128 11-02 14:18:11.906 29254 29254 I Memory : add() 11-02 14:18:11.906 29254 29254 I ModelBuilder: setOperandValue for operand 3 size 4 11-02 14:18:11.906 29254 29254 I ModelBuilder: Copied small value to offset 0 11-02 14:18:11.906 29254 29254 I ModelBuilder: setOperandValue for operand 4 size 4 11-02 14:18:11.906 29254 29254 I ModelBuilder: Copied small value to offset 4 11-02 14:18:11.906 29254 29254 I ModelBuilder: setOperandValue for operand 5 size 4 11-02 14:18:11.906 29254 29254 I ModelBuilder: Copied small value to offset 8 11-02 14:18:11.906 29254 29254 I ModelBuilder: setOperandValue for operand 6 size 4 11-02 14:18:11.906 29254 29254 I ModelBuilder: Copied small value to offset 12 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 8 offset 2400848 size 288 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 9 offset 4219436 size 128 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 10 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 16 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 11 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 20 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 12 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 24 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 13 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 28 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 14 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 32 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 16 offset 3995772 size 2048 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 17 offset 4219576 size 256 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 18 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 36 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 19 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 40 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 20 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 44 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 21 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 48 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 23 offset 2400260 size 576 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 24 offset 4219844 size 256 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 25 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 52 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 26 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 56 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 27 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 60 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 28 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 64 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 29 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 68 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 31 offset 3997840 size 8192 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 32 offset 4220112 size 512 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 33 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 72 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 34 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 76 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 35 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 80 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 36 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 84 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 38 offset 2397036 size 1152 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 39 offset 4220636 size 512 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 40 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 88 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 41 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 92 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 42 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 96 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 43 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 100 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 44 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 104 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 46 offset 2376020 size 16384 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 47 offset 3431192 size 512 11-02 14:18:11.907 29254 29254 I Memory : add() 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 48 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 108 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 49 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 112 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 50 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 116 11-02 14:18:11.907 29254 29254 I ModelBuilder: setOperandValue for operand 51 size 4 11-02 14:18:11.907 29254 29254 I ModelBuilder: Copied small value to offset 120 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 53 offset 4217608 size 1152 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 54 offset 4218772 size 512 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 55 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 124 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 56 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 128 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 57 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 132 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 58 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 136 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 59 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 140 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 61 offset 3962980 size 32768 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 62 offset 4221160 size 1024 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 63 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 144 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 64 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 148 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 65 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 152 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 66 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 156 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 68 offset 3436360 size 2304 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 69 offset 4222196 size 1024 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 70 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 160 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 71 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 164 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 72 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 168 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 73 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 172 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 74 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 176 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 76 offset 4141756 size 65536 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 77 offset 4223232 size 1024 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 78 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 180 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 79 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 184 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 80 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 188 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 81 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 192 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 83 offset 2369080 size 2304 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 84 offset 4207316 size 1024 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 85 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 196 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 86 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 200 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 87 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 204 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 88 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 208 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 89 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 212 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 91 offset 4006048 size 131072 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 92 offset 4224268 size 2048 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 93 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 216 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 94 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 220 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 95 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 224 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 96 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 228 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 98 offset 2102304 size 4608 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 99 offset 4226328 size 2048 11-02 14:18:11.908 29254 29254 I Memory : add() 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 100 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 232 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 101 size 4 11-02 14:18:11.908 29254 29254 I ModelBuilder: Copied small value to offset 236 11-02 14:18:11.908 29254 29254 I ModelBuilder: setOperandValue for operand 102 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 240 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 103 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 244 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 104 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 248 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 106 offset 2106924 size 262144 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 107 offset 2403208 size 2048 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 108 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 252 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 109 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 256 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 110 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 260 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 111 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 264 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 113 offset 2097684 size 4608 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 114 offset 4228388 size 2048 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 115 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 268 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 116 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 272 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 117 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 276 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 118 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 280 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 119 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 284 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 121 offset 1835524 size 262144 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 122 offset 2401148 size 2048 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 123 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 288 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 124 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 292 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 125 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 296 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 126 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 300 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 128 offset 2392416 size 4608 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 129 offset 4230448 size 2048 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 130 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 304 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 131 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 308 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 132 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 312 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 133 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 316 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 134 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 320 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 136 offset 1573368 size 262144 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 137 offset 4232508 size 2048 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 138 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 324 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 139 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 328 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 140 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 332 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 141 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 336 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 143 offset 4137136 size 4608 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 144 offset 4234568 size 2048 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 145 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 340 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 146 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 344 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 147 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 348 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 148 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 352 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 149 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 356 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 151 offset 460 size 262144 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 152 offset 2398200 size 2048 11-02 14:18:11.909 29254 29254 I Memory : add() 11-02 14:18:11.909 29254 29254 I ModelBuilder: setOperandValue for operand 153 size 4 11-02 14:18:11.909 29254 29254 I ModelBuilder: Copied small value to offset 360 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 154 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 364 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 155 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 368 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 156 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 372 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 158 offset 3431740 size 4608 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 159 offset 4236628 size 2048 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 160 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 376 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 161 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 380 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 162 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 384 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 163 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 388 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 164 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 392 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 166 offset 1311208 size 262144 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 167 offset 4238688 size 2048 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 168 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 396 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 169 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 400 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 170 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 404 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 171 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 408 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 173 offset 2371400 size 4608 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 174 offset 4240748 size 2048 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 175 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 412 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 176 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 416 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 177 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 420 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 178 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 424 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 179 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 428 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 181 offset 3438680 size 524288 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 182 offset 4242808 size 4096 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 183 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 432 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 184 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 436 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 185 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 440 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 186 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 444 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 188 offset 4208356 size 9216 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 189 offset 4246916 size 4096 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 190 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 448 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 191 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 452 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 192 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 456 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 193 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 460 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 194 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 464 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 196 offset 262616 size 1048576 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 197 offset 4251024 size 4096 11-02 14:18:11.910 29254 29254 I Memory : add() 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 198 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 468 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 199 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 472 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 200 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 476 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 201 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 480 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 203 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 484 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 204 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 488 11-02 14:18:11.910 29254 29254 I ModelBuilder: setOperandValue for operand 205 size 4 11-02 14:18:11.910 29254 29254 I ModelBuilder: Copied small value to offset 492 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValue for operand 206 size 4 11-02 14:18:11.911 29254 29254 I ModelBuilder: Copied small value to offset 496 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValue for operand 207 size 4 11-02 14:18:11.911 29254 29254 I ModelBuilder: Copied small value to offset 500 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValue for operand 208 size 4 11-02 14:18:11.911 29254 29254 I ModelBuilder: Copied small value to offset 504 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 210 offset 2406152 size 1025024 11-02 14:18:11.911 29254 29254 I Memory : add() 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 211 offset 4255132 size 4004 11-02 14:18:11.911 29254 29254 I Memory : add() 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValue for operand 212 size 4 11-02 14:18:11.911 29254 29254 I ModelBuilder: Copied small value to offset 508 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValue for operand 213 size 4 11-02 14:18:11.911 29254 29254 I ModelBuilder: Copied small value to offset 512 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValue for operand 214 size 4 11-02 14:18:11.911 29254 29254 I ModelBuilder: Copied small value to offset 516 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValue for operand 215 size 4 11-02 14:18:11.911 29254 29254 I ModelBuilder: Copied small value to offset 520 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValueFromMemory for operand 217 offset 4259148 size 8 11-02 14:18:11.911 29254 29254 I Memory : add() 11-02 14:18:11.911 29254 29254 I ModelBuilder: setOperandValue for operand 219 size 4 11-02 14:18:11.911 29254 29254 I ModelBuilder: Copied small value to offset 524 11-02 14:18:11.911 29254 29254 I ModelBuilder: copyLargeValuesToSharedMemory has 0 values. 11-02 14:18:11.912 29254 29254 I GraphDump: // ModelBuilder::finish 11-02 14:18:11.912 29254 29254 I GraphDump: digraph { 11-02 14:18:11.912 29254 29254 I GraphDump: d0 [style=filled fillcolor=black fontcolor=white label="0\nTQ8A(1x224x224x3)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d1 [label="1: REF\nTQ8A(32x3x3x3)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d2 [label="2: REF\nTI32(32)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d3 [label="3: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d4 [label="4: COPY\nI32 = 2"] 11-02 14:18:11.912 29254 29254 I GraphDump: d5 [label="5: COPY\nI32 = 2"] 11-02 14:18:11.912 29254 29254 I GraphDump: d6 [label="6: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d7 [label="7\nTQ8A(1x112x112x32)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d8 [label="8: REF\nTQ8A(1x3x3x32)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d9 [label="9: REF\nTI32(32)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d10 [label="10: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d11 [label="11: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d12 [label="12: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d13 [label="13: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d14 [label="14: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d15 [label="15\nTQ8A(1x112x112x32)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d16 [label="16: REF\nTQ8A(64x1x1x32)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d17 [label="17: REF\nTI32(64)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d18 [label="18: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d19 [label="19: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d20 [label="20: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d21 [label="21: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d22 [label="22\nTQ8A(1x112x112x64)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d23 [label="23: REF\nTQ8A(1x3x3x64)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d24 [label="24: REF\nTI32(64)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d25 [label="25: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d26 [label="26: COPY\nI32 = 2"] 11-02 14:18:11.912 29254 29254 I GraphDump: d27 [label="27: COPY\nI32 = 2"] 11-02 14:18:11.912 29254 29254 I GraphDump: d28 [label="28: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d29 [label="29: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d30 [label="30\nTQ8A(1x56x56x64)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d31 [label="31: REF\nTQ8A(128x1x1x64)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d32 [label="32: REF\nTI32(128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d33 [label="33: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d34 [label="34: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d35 [label="35: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d36 [label="36: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d37 [label="37\nTQ8A(1x56x56x128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d38 [label="38: REF\nTQ8A(1x3x3x128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d39 [label="39: REF\nTI32(128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d40 [label="40: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d41 [label="41: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d42 [label="42: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d43 [label="43: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d44 [label="44: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d45 [label="45\nTQ8A(1x56x56x128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d46 [label="46: REF\nTQ8A(128x1x1x128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d47 [label="47: REF\nTI32(128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d48 [label="48: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d49 [label="49: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d50 [label="50: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d51 [label="51: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d52 [label="52\nTQ8A(1x56x56x128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d53 [label="53: REF\nTQ8A(1x3x3x128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d54 [label="54: REF\nTI32(128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d55 [label="55: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d56 [label="56: COPY\nI32 = 2"] 11-02 14:18:11.912 29254 29254 I GraphDump: d57 [label="57: COPY\nI32 = 2"] 11-02 14:18:11.912 29254 29254 I GraphDump: d58 [label="58: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d59 [label="59: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d60 [label="60\nTQ8A(1x28x28x128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d61 [label="61: REF\nTQ8A(256x1x1x128)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d62 [label="62: REF\nTI32(256)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d63 [label="63: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d64 [label="64: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d65 [label="65: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d66 [label="66: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d67 [label="67\nTQ8A(1x28x28x256)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d68 [label="68: REF\nTQ8A(1x3x3x256)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d69 [label="69: REF\nTI32(256)"] 11-02 14:18:11.912 29254 29254 I GraphDump: d70 [label="70: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d71 [label="71: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d72 [label="72: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d73 [label="73: COPY\nI32 = 1"] 11-02 14:18:11.912 29254 29254 I GraphDump: d74 [label="74: COPY\nI32 = 0"] 11-02 14:18:11.912 29254 29254 I GraphDump: d75 [label="75\nTQ8A(1x28x28x256)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d76 [label="76: REF\nTQ8A(256x1x1x256)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d77 [label="77: REF\nTI32(256)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d78 [label="78: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d79 [label="79: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d80 [label="80: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d81 [label="81: COPY\nI32 = 0"] 11-02 14:18:11.913 29254 29254 I GraphDump: d82 [label="82\nTQ8A(1x28x28x256)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d83 [label="83: REF\nTQ8A(1x3x3x256)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d84 [label="84: REF\nTI32(256)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d85 [label="85: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d86 [label="86: COPY\nI32 = 2"] 11-02 14:18:11.913 29254 29254 I GraphDump: d87 [label="87: COPY\nI32 = 2"] 11-02 14:18:11.913 29254 29254 I GraphDump: d88 [label="88: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d89 [label="89: COPY\nI32 = 0"] 11-02 14:18:11.913 29254 29254 I GraphDump: d90 [label="90\nTQ8A(1x14x14x256)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d91 [label="91: REF\nTQ8A(512x1x1x256)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d92 [label="92: REF\nTI32(512)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d93 [label="93: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d94 [label="94: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d95 [label="95: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d96 [label="96: COPY\nI32 = 0"] 11-02 14:18:11.913 29254 29254 I GraphDump: d97 [label="97\nTQ8A(1x14x14x512)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d98 [label="98: REF\nTQ8A(1x3x3x512)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d99 [label="99: REF\nTI32(512)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d100 [label="100: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d101 [label="101: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d102 [label="102: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d103 [label="103: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d104 [label="104: COPY\nI32 = 0"] 11-02 14:18:11.913 29254 29254 I GraphDump: d105 [label="105\nTQ8A(1x14x14x512)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d106 [label="106: REF\nTQ8A(512x1x1x512)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d107 [label="107: REF\nTI32(512)"] 11-02 14:18:11.913 29254 29254 I GraphDump: d108 [label="108: COPY\nI32 = 1"] 11-02 14:18:11.913 29254 29254 I GraphDump: d109 [label="109: COPY\nI32 = 1"] 11-02 14:18:11.922 1029 15537 I aiserver: IPUNNAdaptor getSupportedOperations_1_1 11-02 14:18:11.922 1029 15537 I aiserver: AiModelMngrService getSupportedOperations_1_1 11-02 14:18:11.923 1029 15537 E aiserver: AiModelMngrServic::getSupportedOperations_1_1 not relaxed Model. 11-02 14:18:11.927 2375 2470 I OllieMsgCenter: publishEvt what:2135162884 11-02 14:18:11.933 29254 29254 E libc : Access denied finding property "ro.hardware.chipname" 11-02 14:18:11.928 29254 29254 W benchmark_model: type=1400 audit(0.0:752014): avc: denied { read } for pid=29254 name="u:object_r:vendor_default_prop:s0" dev="tmpfs" ino=15480 scontext=u:r:shell:s0 tcontext=u:object_r:vendor_default_prop:s0 tclass=file permissive=0 ``` To confirm that NPU exists and is available ``` robert@robert:~/Downloads$ adb shell lshal | grep neural Warning: Skipping "android.frameworks.cameraservice.service@2.0::ICameraService/default": cannot be fetched from service manager (null) Warning: Skipping "android.frameworks.displayservice@1.0::IDisplayService/default": cannot be fetched from service manager (null) Warning: Skipping "android.frameworks.schedulerservice@1.0::ISchedulingPolicyService/default": cannot be fetched from service manager (null) Warning: Skipping "android.frameworks.sensorservice@1.0::ISensorManager/default": cannot be fetched from service manager (null) Warning: Skipping "android.frameworks.stats@1.0::IStats/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.audio.effect@5.0::IEffectsFactory/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.audio@5.0::IDevicesFactory/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.biometrics.fingerprint@2.1::IBiometricsFingerprint/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.bluetooth.audio@2.0::IBluetoothAudioProvidersFactory/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.bluetooth@1.0::IBluetoothHci/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.camera.provider@2.4::ICameraProvider/legacy/0": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.gatekeeper@1.0::IGatekeeper/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.gnss@1.0::IGnss/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.gnss@1.1::IGnss/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.gnss@2.0::IGnss/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.graphics.composer@2.1::IComposer/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.graphics.composer@2.2::IComposer/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.health@2.0::IHealth/backup": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.health@2.0::IHealth/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.ir@1.0::IConsumerIr/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.keymaster@3.0::IKeymasterDevice/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.light@2.0::ILight/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.media.c2@1.0::IComponentStore/software": no information for PID 1021, are you root? Warning: Skipping "android.hardware.memtrack@1.0::IMemtrack/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.nfc@1.0::INfc/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.nfc@1.1::INfc/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.nfc@1.2::INfc/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.power.stats@1.0::IPowerStats/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.power@1.0::IPower/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.radio.config@1.0::IRadioConfig/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.radio.config@1.1::IRadioConfig/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.radio@1.0::IRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.radio@1.1::IRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.radio@1.2::IRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.radio@1.3::IRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.radio@1.4::IRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.secure_element@1.0::ISecureElement/SIM1": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.sensors@1.0::ISensors/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.soundtrigger@2.0::ISoundTriggerHw/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.thermal@1.0::IThermal/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.usb@1.0::IUsb/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.vibrator@1.0::IVibrator/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.wifi.supplicant@1.0::ISupplicant/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.wifi.supplicant@1.1::ISupplicant/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.wifi.supplicant@1.2::ISupplicant/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.wifi@1.0::IWifi/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.wifi@1.1::IWifi/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.wifi@1.2::IWifi/default": cannot be fetched from service manager (null) Warning: Skipping "android.hardware.wifi@1.3::IWifi/default": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/SIM1": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/ashmem": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/backup": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/default": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/eid": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/hiaiserver": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/hiaiserver_modelmanager": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/hiaiserver_v2": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/huawei.camera.cfgsvr": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/huawei.cameraresource.service": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/huaweiantitheft": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/huaweisigntool": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/hwfactoryinterface_hal": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/hwhiview_hal": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/hwsched": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/hwstp": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/hwvoiceid": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/ipuadaptor": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/legacy/0": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/perfgenius": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/perfpolicy": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/rildi": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/slot1": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/software": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/uniperf": cannot be fetched from service manager (null) Warning: Skipping "android.hidl.base@1.0::IBase/virtualcamera.streamchange": cannot be fetched from service manager (null) Warning: Skipping "android.system.net.netd@1.0::INetd/default": cannot be fetched from service manager (null) Warning: Skipping "android.system.net.netd@1.1::INetd/default": cannot be fetched from service manager (null) Warning: Skipping "android.system.suspend@1.0::ISystemSuspend/default": cannot be fetched from service manager (null) Warning: Skipping "android.system.wifi.keystore@1.0::IKeystore/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.activity_recognition@1.0::IActivityRecognition/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.activity_recognition@1.1::IActivityRecognition/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.audioremote@1.0::IAudioRemoteConnect/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.biometrics.fingerprint@2.1::IExtBiometricsFingerprint/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.biometrics.fingerprint@2.2::IExtBiometricsFingerprint/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.biometrics.hwfacerecognize@2.0::IBiometricsFaceRecognize/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.biometrics.hwsecurefacerecognize@2.0::ISecureBiometricsFaceRecognize/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.biometrics.hwvoiceid@2.0::IBiometricsVoiceId/hwvoiceid": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.bluetooth@1.0::IHwBluetoothHciExt/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.bluetooth@1.1::IHwBluetoothHciExt/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.camera.camResource@1.0::IHwCameraResourceService/huawei.cameraresource.service": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.camera.camResource@1.1::IHwCameraResourceService/huawei.cameraresource.service": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.camera.camResource@1.2::IHwCameraResourceService/huawei.cameraresource.service": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.camera.camResource@1.3::IHwCameraResourceService/huawei.cameraresource.service": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.camera.cfgsvr@1.0::IHwCamCfgSvr/huawei.camera.cfgsvr": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.camera.cfgsvr@1.1::IHwCamCfgSvr/huawei.camera.cfgsvr": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.camera.factory@1.0::ICameraFactory/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.camera.vircamera@1.0::IVirCameraChannel/virtualcamera.streamchange": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.dolby.dms@1.0::IDms/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.dubai@1.0::IDubaiManager/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.dubai@1.1::IDubaiManager/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.eid@1.0::IEid/eid": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.eid@1.1::IEid/eid": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.fm@1.0::IFmControl/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.fusd@1.0::IFusdLbs/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.fusd@1.1::IFusdLbs/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.fusd@1.2::IFusdLbs/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.fusd@1.3::IFusdLbs/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.fusd@1.4::IFusdLbs/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.fusd@1.5::IFusdLbs/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.fusd@1.6::IFusdLbs/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.gnss@2.0::IHWGnss/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.graphics.hwcinterface@1.0::IHwcInterface/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.graphics.hwcinterface@1.1::IHwcInterface/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.graphics.mediacomm@2.0::IMediaComm/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.graphics.mediacomm@2.1::IMediaComm/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hinetmanager@1.0::IHinetmanagerDevice/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hisiradio@1.0::IHisiRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hisiradio@1.1::IHisiRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hisiradio@1.2::IHisiRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hisiradio@1.3::IHisiRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hivrar@2.0::IHiVRAR/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hivrar@2.1::IHiVRAR/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.huaweiantitheft@1.0::IHuaweiAntiTheft/huaweiantitheft": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.huaweisigntool@1.0::ISignTool/huaweisigntool": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwdisplay.displayengine@1.0::IDisplayEngineWrapper/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwdisplay.displayengine@1.1::IDisplayEngineWrapper/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwdisplay.displayengine@1.2::IDisplayEngineWrapper/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwdisplay@1.0::IDisplay/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwfactoryinterface@1.0::IHwFactoryInterface/hwfactoryinterface_hal": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwfactoryinterface@1.1::IHwFactoryInterface/hwfactoryinterface_hal": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwfs@1.0::IHwfs/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwhiview@1.0::IHwHiviewInterface/hwhiview_hal": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwhiview@1.1::IHwHiviewInterface/hwhiview_hal": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwsched@1.0::ISched/hwsched": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwstp@1.0::IHwStp/hwstp": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwstp@1.1::IHwStp/hwstp": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwvibrator@1.0::IHWVibrator/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.hwvibrator@1.1::IHWVibrator/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.iawareperf@1.0::IUniPerf/uniperf": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.iawareperfpolicy@1.0::IPerfPolicy/perfpolicy": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.iked@1.0::IIkedDevice/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.jpegdec@1.0::IJpegDecode/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.libteec@3.0::ILibteecGlobal/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.light@2.0::ILight/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.modemchr@1.0::IModemchrDevice/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.motion@1.0::IMotion/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.nfc@1.0::IHWNfc/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.perfgenius@2.0::IPerfGenius/perfgenius": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.power@1.0::IHWPower/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.radio.chr@1.0::IRadioChr/slot1": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.radio.deprecated@1.0::IOemHook/slot1": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.radio.ims@2.0::IRadioIms/rildi": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.radio@2.0::IRadio/slot1": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.sensors@1.0::ISensors/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.sensors@1.1::ISensors/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.tp@1.0::ITouchscreen/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.wifi.supplicant@3.0::ISupplicant/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.wifi@1.0::IHwWifiExt/default": cannot be fetched from service manager (null) Warning: Skipping "vendor.huawei.hardware.wifi@1.1::IHwWifiExt/default": cannot be fetched from service manager (null) DM,FC Y android.hardware.neuralnetworks@1.0::IDevice/ipuadaptor N/A N/A DM,FC Y android.hardware.neuralnetworks@1.1::IDevice/ipuadaptor N/A N/A ```

github.com

tensorflow/tensorflow/blob/master/tensorflow/lite/delegates/nnapi/nnapi_delegate_device_selection_test.cc#L285-L291

      
        
            nnapi_mock_->StubGetSupportedOperationsForDevicesWith(
                [](const ANeuralNetworksModel* model,
                   const ANeuralNetworksDevice* const* devices, uint32_t numDevices,
                   bool* supportedOps) -> int {
                  std::fill(supportedOps, supportedOps + 1, true);
                  return ANEURALNETWORKS_NO_ERROR;
                });

https://developer.android.com/ndk/reference/group/neural-networks#aneuralnetworksmodel_getsupportedoperationsfordevices

KrockS · March 2, 2022, 10:56am

Guys sorry, most of our team is in Ukraine, Kharkiv and we have another priorities right now. We will try to check it a bit later when we would be able.

KrockS · July 12, 2022, 12:03pm

We ended up creating profile table (different inputs size and architecture) for different devices with hard coded GPU delegate.