IDS NXT Bedienungsanleitung

IDS NXT

IDS Imaging Development Systems GmbH

Dimbacher Str. 10

D-74182 Obersulm, Germany

T: +49 7134 96196-0

E: info@ids-imaging.com

W: http://www.ids-nxt.com

Vision apps – Object Detector

October 2021 2

IDS NXT: Vision apps – Object Detector

Content

1 Preface ............................................................................................................................................. 3

2 Symbolsand hints ............................................................................................................................ 5

3 Vision app "Object Detector" ............................................................................................................ 6

3.1 Overview ...................................................................................................................................... 7

3.2 Settings ...................................................................................................................................... 8

3.3 Files ........................................................................................................................................... 9

3.4 Result output ............................................................................................................................... 9

3.5 Website .................................................................................................................................... 10

4 Interface description vision app "Object Detector" ......................................................................... 11

4.1 /vapps/objectdetector .................................................................................................................. 11

4.2 /vapps/objectdetector/configurables .............................................................................................. 12

4.3 /vapps/objectdetector/files/cnnfile/data ......................................................................................... 13

4.4 /vapps/<%REST-NAME-API%>/ftpclient ....................................................................................... 14

4.5 /vapps/objectdetector/images/default ............................................................................................ 15

4.6 /vapps/objectdetector/resultsources/last ....................................................................................... 16

4.7 Error codes ................................................................................................................................ 17

Index ................................................................................................................................................. 18

October 2021 3

IDS NXT: Vision apps – Object Detector

1 Preface

Introduction

IDS Imaging Development Systems GmbH has taken every possible care in preparing this manual. We however

assume no liability for the content, completeness or quality of the information contained therein. The content of

this manual is regularly updated and adapted to reflect the current status of the software. We furthermore do

not guarantee that this product will function without errors, even if the stated specifications are adhered to.

Under no circumstances can we guarantee that a particular objective can be achieved with the purchase of this

product.

Insofar as permitted under statutory regulations, we assume no liability for direct damage, indirect damage or

damages suffered by third parties resulting from the purchase of this product. In no event shall any liability

exceed the purchase price of the product.

Please note that the content of this manual is neither part of any previous or existing agreement, promise,

representation or legal relationship, nor an alteration or amendment thereof. All obligations of IDS Imaging

Development Systems GmbH result from the respective contract of sale, which also includes the complete and

exclusively applicable warranty regulations. These contractual warranty regulations are neither extended nor

limited by the information contained in this manual. Should you require further information on this product, or

encounter specific problems that are not discussed in sufficient detail in the manual, please contact your local

dealer or system installer.

Trademarks

The IDS logo is a registered trademark of IDS Imaging Development Systems GmbH,

registered for U.S. (Reg.No. 4,513,138) and other countries.

IDS NXT and uEye are registered trademarks of IDS Imaging Development Systems GmbH. Microsoft and

Windows are trademarks or registered trademarks of Microsoft Corporation. All other products or company

names mentioned in this manual are used solely for purposes of identification or description and may be

trademarks or registered trademarks of the respective owners.

transmitted or translated to another language, either as a whole or in parts, without the prior written permission

of IDS Imaging Development Systems GmbH.

Status: October 2021

October 2021 4

IDS NXT: Vision apps – Object Detector

Contact

Visit our web site http://www.ids-nxt.com where you will find all the latest information about our software and

hardware products. Please contact your local IDS distributors for first level support in your language. For a list

of IDS distributors worldwide please go to our website http://www.ids-nxt.com.

Address

IDS Imaging Development Systems GmbH

Dimbacher Str. 10

D-74182 Obersulm, Germany

+49 7134 96196-0

info@ids-imaging.com

http://www.ids-nxt.com

Address in UK

IDS Imaging Development Systems Ltd.

Landmark House, Station Road

RG27 9HA Hook | United Kingdom

+44 1256 962910

info@ids-imaging.com

https://en.ids-imaging.com

October 2021 5

IDS NXT: Vision apps – Object Detector

2 Symbols and hints

This symbol indicates hints with useful information for better understanding and using features

and functions.

This symbol indicates important warnings for product safety to prevent damage.

This symbol indicates important warnings for personal safety to prevent injury.

October 2021 6

IDS NXT: Vision apps – Object Detector

3 Vision app "Object Detector"

For version 1.8.5 of the vision app Object Detector, at least IDS NXT OS version 1.3.0. or

higher must be installed on the camera.

Vision app Object Detector allows you to locate and classify several objects in an image using a CNN

(convolutional neural network). It is not necessary to know the position of the objects in the image in advance.

The detection results are displayed with information on the class and number of classes as well as the

probability and ROI per object.

To use CNNs for object detection, the IDS NXT camera must have installed IDS NXT OS

version 1.1 or higher.

The processing of CNNs by the deep ocean core is done exclusively for a single vision app. If

you want to start another vision app, that also requires the deep ocean core, you have to stop

the currently running vision app first.

Classification or object detection

Different vision apps are available for classification or object detection. There may be overlaps in marginal

cases where several points have to be considered whether a classification or an object detection should be

used.

Fig. 1:Classification and object detection

Accuracy: Higher accuracies can be achieved within classification, as each ROI is individually evaluated by a

CNN. The single ROI is scaled to the input size of the CNN (e.g. 224x224 pixels), while object detection

scales the whole image to find objects with different sizes.

October 2021 7

IDS NXT: Vision apps – Object Detector

Inference time: the classification requires generally shorter inference times than object detection for the

evaluation of a single ROI. However, the processing time in classification increases linearly with the number

of ROIs. The inference time for object detection is independent of the number of objects found in the image.

Depending on which CNNs are used, object detection is therefore faster from a certain number of ROIs. If

processing time is important, it may be worth using object detection instead of classification even if the

object positions are known.

Training effort: In general, classification tasks are easier to train than detection tasks. For a classification

only one input per image has to be made and images can be labelled in batches, e.g. by uploading whole

folders to IDS NXT lighthouse. For object detection, images must be individually marked with several boxes,

which results in a higher effort.

3.1 Overview

Fig. 2: Object Detector

1. Selection of the vision app

2. Information about the vision app

3. Switching between vision app settings and the result display ("Highlight")

4. Vision app settings

5. Upload or delete CNN file in vision app

6. Status of the FTP server The use of the FTP server must be activated in the network settings of the camera,

see manual "IDS NXT cockpit".

7. Result of image analysis and selection of the image view (live image, image detail)

October 2021 8

IDS NXT: Vision apps – Object Detector

3.2 Settings

Fig. 3: Select CNN package

CNN

Select a CNN for the evaluation. You must load the CNN onto the camera in advance, see Files.

Additional information is displayed for the selected CNN, such as name, architecture, etc.

Which display name is used for the CNN?

If you do not make any changes, the display name will be the name that was used to

create the project in IDS NXT lighthouse or IDS NXT ferry.

You can rename the saved CNN file before uploading to change the display name (requires

IDS NXT OS 1.1 or later and IDS NXT cockpit version 2.1 or later).

Detection threshold

Here, you set the value as of when a detection should be evaluated as a valid result. Note that a value too low

might lead to false detections. On the other hand, a high value can result in objects not being detected.

FTP transfer

Here, you specify which images (including XML file with information about ROIs in the image, such as the class

name or ROI position) are transferred to the FTP server. The images are automatically stored in a subdirectory

called "Objectdetector". You have the following choices:

FTP Disabled: Transfer to the FTP server is disabled.

October 2021 9

IDS NXT: Vision apps – Object Detector

Any Detection: All images with a detection are transferred.

No Detection: Only images without a detection are transferred.

"Class Name": All images with a detection of the selected class will be transferred.

If the camera cannot establish a connection to the FTP server, the transfer of images is interrupted. The

camera will try to connect to the FTP server again in 5 minute intervals. If no connection to the FTP server

could be established after 1 hour, the FTP function is deactivated.

3.3 Files

Fig. 4: Upload a CNN package

Here, you upload a CNN file (*.det) that you have trained previously, e.g. in IDS NXT lighthouse for object

detection. After successfully uploading the CNN file, you can select the CNN in the settings. Object Detector

can use CNNs for object detection created for IDS NXT OS 1.1 or higher

IDS NXT cockpit displays an error message if the CNN packet is large and uploading takes a

long time. The upload is still performed, however. After uploading, the CNN package is

installed, which causes the vision app to take a few seconds to run (as it did the first time the

vision app was started).

Click to delete the currently selected CNN on the device. After deletion, the first CNN from the list

is activated. If the last CNN in the list is deleted, evaluation is not performed any more and you must first

upload a CNN again.

3.4 Result output

Fig. 5: Result output

Switch between overall image and result image

In the result image, all detected objects are displayed with their number, the detection result and the

corresponding probability. Only detections with a probability above the detection threshold are displayed.

Each class is assigned one of six colors, which are repeated if models are trained on more than six classes.

Class: Displays the found class

Count: Frequency of the found class

October 2021 10

IDS NXT: Vision apps – Object Detector

Data: Shows for each ROI the found class, the probability and the size and position of the ROI.

Inference Time: Indicates the inference time in milliseconds.

3.5 Website

You can open the vision app website directly from the IDS NXT cockpit (Vision app manager) or directly access

the corresponding URL (http://<IP address of the camera>/vapps/objectdetector/website).

The website will show you the current image with the corresponding detection results.

Fig. 6: Objektdetektion

Andere Handbücher für NXT

Inhaltsverzeichnis

Andere IDS Sicherheitssensor Handbücher

IDS

IDS Optex Xwave Einrichtungshandbuch

Beliebte Sicherheitssensor Handbücher anderer Marken

THORLABS

THORLABS PDA10JT Bedienungsanleitung

Waeco

Waeco UV-DETECT Bedienungsanleitung

Intermatic

Intermatic IOS-DSIMF Bedienungsanleitung

urmet domus

urmet domus 1083 Bedienungsanleitung

Siemens

Siemens AZL66 Series Bedienungsanleitung

BTI

BTI Profiline Multi Finder Bedienungsanleitung

Challenger

Challenger SL01 Bedienungsanleitung

DMP Electronics

DMP Electronics 1122INT Bedienungsanleitung

Rielta

Rielta Ladoga MK-RK Bedienungsanleitung

Mirion Technologies

Mirion Technologies ACCURAD PRD Bedienungsanleitung

Bosch

Bosch DS835 Bedienungsanleitung

DBI SALA

DBI SALA EZ Stop Bedienerhandbuch

Lamptime

Lamptime ST05C Bedienungsanleitung

Ubiquiti

Ubiquiti MFI-MSC Bedienungsanleitung

Subsite

Subsite 910R Montageanleitung

Satel

Satel OPAL Pro Bedienungsanleitung

Aleph

Aleph XC-1XTEU Bedienungsanleitung

Pima

Pima LARIS QUAD Bedienungsanleitung