NXP Semiconductors SLN-VIZNLC-IOT-UG Bedienungsanleitung

SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

Rev. 0 — 20 February 2023 User guide

Document information

Information Content

Keywords Smart Lock, Smart Access, IoT

Abstract This document describes the low-cost vision solution, also called SLN-VIZNLC-IOT, and its

associated out of box features. The SLN-VIZNLC-IOT turnkey solution provides OEMs with a fully

integrated, self-contained, software, and hardware solution

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

1 Introduction

The SLN-VIZNLC-IOT development kit implements NXP Edge Ready turnkey solution for face recognition-

based access control, using an RGB+IR dual camera module. This kit includes the LPC845 low-power control,

i.MX RT106F runtime library, and pre-integrated machine learning face recognition algorithms, as well as all

required drivers for peripherals, such as memories, cameras, display, Bluetooth Low Energy (Bluetooth LE),

and Wi-Fi (optional). This cost-effective, easy-to-use solution facilitates the deployment of highly accurate face

recognition with robust liveness detection capability. By leveraging an MCU platform, this solution can deliver

the low cost and low power consumption required for battery-powered consumer smart locks, combined with the

quick inferencing, and short boot times required to deliver a great user experience.

Target applications:

•Smart door locks: For consumer and hospitality applications, including single family homes, multiple dwelling

units, and hotels.

•Access control: For office and industrial smart-building applications.

1.1 Processor overview

The i.MX RT106F is an Edge Ready member of the i.MX RT1060 family of crossover processors, targeting

low cost embedded face recognition applications. It features an advanced Arm Cortex-M7 core implementation

from NXP that operates at up to 600 MHz to provide high CPU performance and the best real-time responses.

This i.MX RT106F based solution enables system designers to add face recognition capabilities easily and

inexpensively to a wide variety of smart appliances, smart homes, and smart industrial devices.

The i.MX RT106F processor is licensed to run NXP i.MX RT run-time library for face recognition which may

include:

•Unified cross-platform framework.

•Camera drivers, image capture, and pre-processing.

•Face detection, tracking, alignment, recognition with quantified results and confidence measure, and liveness

detection.

•Display drivers, 2D graphics accelerator supported.

•Built-in security, bootloader, and application validation.

•All drivers including Bluetooth LE and Wi-Fi.

•USB Mass Storage Device (MSD) updates.

•Factory automation scripts.

•Supported by an MCUXpresso SDK, IDE, and configuration tools.

Note: The Wi-Fi feature is enabled in the second SW release.

In addition to the i.MX RT106F, the LPC845 is another Arm Cortex-M0+ core-based processor. The LPC845 is

a low-cost, 32-bit MCU operating at frequencies of up to 30 MHz and supports up to 64 kB of flash memory and

16 kB of SRAM. It features exceptional power efficiency in the low-current mode, and includes rich peripheral

complement I/O ports.

2 Recommended configuration

An up-to-date computer that can run MCUXpresso IDE version is required to modify and debug the SLN-

VIZNLC-IOT example projects (11.6.1 or newer).

User guide Rev. 0 — 20 February 2023

2 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

Computer type OS version Terminal program

Apple MAC OS PuTTY

PC Windows 7/10/11 PuTTY/Tera Term

PC Linux PuTTY

Table 1. Recommended computer configuration

3 Hardware

The SLN-VIZNLC-IOT turnkey solution for face recognition comes with a cost and form-factor-optimized

hardware reference designs and access to full software source code. In addition to the i.MX RT106F and

LPC845 MCUs, rich peripherals are provided to help develop applications. Figure 1 shows the main hardware

resources of the board.

PIR

User

Button

LCD

IR+RGB

Dual Camera

USB

TypeC

LPC845

Wi-Fi M.2

Connector

RT106F

SDRAM

LCD

Connector

K32W061

PCB

Antenna

SPI Flash

RT106F

Reset

LPC845

Reset

RT/LPC/BT

Programming

Header

Speaker

Boot Mode

Jumper

Figure 1. SLN-VIZNLC-IOT components

For more information about the hardware design of the SLN-VIZNLC-IOT, see the SLN-VIZNLC-IOT Hardware

Developer Guide (document SLN-VIZNLC-IOT-HDG).

CAUTION: Depending on the mode of operation, the SLN-VIZNLC-IOT kit can emit highly concentrated white

or non-visible infrared light which can be hazardous to human eyes. Products which incorporate these devices

must follow the safety precautions given in IEC 60825-1 and IEC 62471.

3.1 MCU

In the SLN-VIZNLC-IOT design, the LPC845 manages the low-power control of the entire system and works as

the host MCU. The i.MX RT106F is used to run camera preview, display, and machine learning algorithms.

The power supply of the i.MX RT106F part is controlled by the LPC845. However, by connecting the J11 jumper,

an always-on power mode is enabled for easy debugging. See the box highlighted in green in Figure 6.

3.2 LCD

The SLN-VIZNLC-IOT kit, by default, uses a 2.4 inch TFT display (Rocktech RK024HH298) with 240 x 320

resolution, LED backlight, full viewing angle, and RGB interface.

User guide Rev. 0 — 20 February 2023

3 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

3.3 Speaker

A GSPK1345PN-1M8R1W-L80 enclosed 8 Ω 1.0 W speaker is embedded in the SLN-VIZNLC-IOT kit.

3.4 Camera module

The SLN-VIZNLC-IOT kit uses the GC0308 IR+RGB dual camera module by default. The GC0308 features 640

V x 480 H resolution with 1/6.5-inch optical format, and 4-transistor pixel structure for high image quality and low

noise variations. It delivers superior image quality by powerful on-chip design of a 10-bit ADC, and embedded

image signal processor. The two GC0308 sensors share a single CSI-DVP interface.

3.5 Wireless radios

Usage condition

The following information is provided per Article 10.8 of the Radio Equipment Directive 2014/53/EU:

•Frequency bands in which the equipment operates.

•The maximum RF power transmitted.

PN RF technology Frequency range Maximum

transmitted power

SLN-VIZNLC-IOT Bluetooth 2402-2480 MHz 10 dBm

Table 2. Bluetooth frequency and power

EUROPEAN DECLARATION of CONFORMITY (Simplified DoC per Article 10.9 of the Radio Equipment

Directive 2014/53/EU)

This apparatus, namely SLN-VIZNLC-IOT, conforms to the Radio Equipment Directive 2014/53/EU. For the full

EU Declaration of Conformity for this apparatus, see SLN-VIZNLC-IOT.

4 RT106F bootloader

The SLN-VIZNLC-IOT employs a multi-stage boot process to enhance the capabilities of the out-of-box

firmware (FW) to include additional functionality. For instance, the ability to flash new firmware images remotely

and without a debugging probe for the i.MX RT106F.

4.1 Normal boot

By default, if no boot flags are set during the boot phase, the Normal Boot mode is used. During Normal Boot,

the bootloader boots into the "main" out-of-box demo application, meaning the bootloader has jumped to the

flash address associated with the application.

4.2 Boot modes

The bootloader supports several different boot-up methods which augment the boot-up behavior. These

methods include Normal Boot mode (default) and MSD mode for drag-and-drop flashing of new firmware

images. The following sections describe the usage of each different Boot mode and how to enable them.

A high-level overview of the purpose of each of these features is discussed in the following sections. For

information regarding their usage, creating update payloads, and more, see SLN-VIZNLC-IOT Software

Developer Guide (document SLN-VIZNLC-IOT-SDG).

User guide Rev. 0 — 20 February 2023

4 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

4.3 Mass Storage Device

The MSD feature allows the SLN-VIZNLC-IOT to receive firmware updates without a debugging probe like

a SEGGER J-Link. Instead, MSD uses USB to emulate an MSD interface like the one that is used for USB

flash drives. This feature can be especially useful for marketers or engineers in the field without access to a

dedicated debug probe tool. When the kit is powered on, hold down the MSD pushbutton (SW3) on the front of

the kit to activate MSD mode.

Figure 2. MSD pushbutton (SW3)

Once enabled, the kit enumerates as a USB Storage Device by the OS of your computer.

Figure 3. New USB drive for SLN-VIZNLC-IOT kit

To update the firmware image on your kit, drag and drop the new binary to the USB drive corresponding to

your kit. Assuming the binary is properly generated, the bootloader automatically updates the firmware on your

device. Flashing a new firmware image results in a pop-up window identical to the one used when copying files

to a real USB flash drive device.

User guide Rev. 0 — 20 February 2023

5 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

Figure 4. Copying new binary to the USB drive

Note:

•Keep the i.MX RT106F in always-on power mode, when using MSD.

•Only the main application can be updated using MSD. The bootloader cannot be updated using MSD and

requires the use of a SEGGER J-Link Debug Probe or the Factory Programming Flow. Instructions on MSD,

J-Link-based updates, and the Factory Programming Flow can be found in the SLN-VIZNLC-IOT Software

Developer Guide (document SLN-VIZNLC-IOT_SDG).

For more information regarding MSD mode and its usage, and instructions on generating FW binaries

compatible with MSD mode, see the SLN-VIZNLC-IOT Software Developer Guide (document SLN-VIZNLC-

IOT-SDG).

5 Out-of-box demo application

5.1 Overview

The SLN-VIZNLC-IOT supports Smart Lock (default) and Smart Access applications. These example

applications are built to showcase the complex machine vision, voice prompt, and graphical UI capabilities the

kit supports. They also provide a base software platform for rapid integration of unique customer applications

and requirements.

The Smart Lock application presents an example of a potential smart lock use case. Here, a smart lock device

provides custom user experiences using face recognition.

The Smart Access application presents an example of a potential smart access use case. Here, a smart

access device provides custom user experiences using face recognition.

The main difference between the two applications is the images used for face recognition. Face recognition

uses IR images for smart lock applications and RGB images for smart access applications.

If you want to build the smart access application, change the symbol definition from "SMART_LOCK_2D" to

"SMART_ACCESS_2D" in the project settings.

User guide Rev. 0 — 20 February 2023

6 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

Figure 5. How to build Smart Access application

5.2 Smart Lock

The following sections describe the out-of-box features of smart lock in default. It also applies to smart access

application, except for few GUI display.

5.2.1 Power on

Take the USB-A > USB-C cable provided inside the kit. Plug the USB-A end into the USB port on your computer

and the USB-C end into the USB port of the kit.

Figure 6. Power on the SLN-VIZNLC-IOT kit

Note: LPC845 controls the power supply of i.MX RT106F and K32W061. However, an always-on power mode

is supported for easy debugging by connecting J11 jumper as shown in the box highlighted in green in Figure 6.

User guide Rev. 0 — 20 February 2023

7 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

When powered on, the onboard TFT screen streams video directly from the RGB camera alongside a GUI

overlay, providing information such as:

•Locked/Unlocked status whether a face is recognized.

•Current app type (Smart Lock/Access).

•ON/OFF status of Wi-Fi and Bluetooth LE.

•Number of registered users.

Figure 7. The screen with video preview

When J11 is not connected and no PIR event is triggered after a 30 s timeout, the entire system enters the low-

power mode. Now, the screen is off and the power supply of i.MX RT106F is cut off. When new PIR event is

triggered, the system wakes up immediately.

When J11 is connected, the screen is always on. The i.MX RT106F is powered on all the time, and face

recognition does not stop working.

5.2.2 Register a face

To begin registering a new face, press the Manual Registration button (SW4) on the kit or use shell command

(add username). For shell commands, see the description later.

User guide Rev. 0 — 20 February 2023

8 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

Figure 8. Manual registration button (SW4)

Once pressed, a message indicating registration is taking place pops up at the top of the screen. The speaker

plays an audio message confirming that the registration has started.

Figure 9. Registering screen

Figure 9 shows that while registration is taking place, the GUI displays:

•A “Registering” message.

•Face alignment guidelines.

•A countdown timer bar.

The guidelines help you align your face correctly during registration, and the countdown timer indicates how

much longer it takes until the registration procedure times out and fails.

User guide Rev. 0 — 20 February 2023

9 / 27

NXP Semiconductors SLN-VIZNLC-IOT-UG

SLN-VIZNLC-IOT User Guide

Figure 10. Registration Timeout

As an additional measure to aid in registering your face, the kit even plays a warning audio prompt, saying

"Look at Camera," until your face is properly pointed toward the camera, if too much of the side of your face is

exposed during the registration process.

Should your face fail to register, simply press the SW4 button again to retry.

Once your face is successfully registered, the kit displays the message "Registration Successful", and a unique

identifier is assigned to your face. The number of registered users is also updated automatically.

Figure 11. Registration Successful

5.2.3 Recognize a face

Once registered, the kit displays the message "Recognition Successful" and plays a corresponding audio file

when a recognized face is detected.

User guide Rev. 0 — 20 February 2023

10 / 27

Inhaltsverzeichnis

Andere NXP Semiconductors Mikrocontroller Handbücher

NXP Semiconductors

NXP Semiconductors MC9S12XS256 Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors LPC5500 Series Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors HCS12 Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors P89LPC980 Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors MPC5606BK Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors LPC29 Series Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors LPC5500 Series Referenzhandbuch

NXP Semiconductors

NXP Semiconductors SAFE ASSURE Qorivva MPC5602P Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors Freescale K22 Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors A71CL Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors S32G-VNP-GLDBOX Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors QN9020 mini DK Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors MPC5777M Benutzerhandbuch

NXP Semiconductors

NXP Semiconductors TWR-K21F120M Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors S12ZVM-EWP Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors NTAG I2C plus Gebrauchs- und Pflegehandbuch

NXP Semiconductors

NXP Semiconductors Freescale Freedom Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors PN7462AU Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors USB-KW38 Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors TWR-KM34Z50M Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors S12ZVML-MINIKIT Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors FRDM-K32L2B3 Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors ARM Cortex M0+ Bedienungsanleitung

NXP Semiconductors

NXP Semiconductors P89LPC952 Bedienungsanleitung

Beliebte Mikrocontroller Handbücher anderer Marken

Novatek

Novatek NT6861 Bedienungsanleitung

Espressif Systems

Espressif Systems ESP8266 SDK Einrichtungshandbuch

Nuvoton

Nuvoton ISD61S00 ChipCorder Leitfaden

STMicrolectronics

STMicrolectronics ST7 Assembler Linker Bedienungsanleitung

Texas Instruments

Texas Instruments Chipcon CC2420DK Bedienungsanleitung

Lantronix

Lantronix Intrinsyc Open-Q 865XR SOM Bedienungsanleitung

NEC

NEC 78GK0S/K 1+ Series Montage- und Bedienungsanleitung

Mikroe

Mikroe SEMITECH N-PLC Click Montage- und Bedienungsanleitung

Intel

Intel Agilex Bedienungsanleitung

Cypress

Cypress CY4607 HX2VL Bedienungsanleitung

DIGITAL-LOGIC

DIGITAL-LOGIC MICROSPACE Bedienungsanleitung

Texas Instruments

Texas Instruments TMS320F2837 D Series Bedienungsanleitung

CYPRES

CYPRES CY14NVSRAMKIT-001 Bedienungsanleitung

Espressif Systems

Espressif Systems ESP8266EX Betriebsanleitung

Abov

Abov AC33M8128L Bedienungsanleitung

Laird

Laird BL654PA Bedienungsanleitung

Silicon Laboratories

Silicon Laboratories C8051F800 Bedienungsanleitung

Energy micro

Energy micro EFM32 Giant Gecko Starter Kit Bedienungsanleitung