Renesas / Mbed OS GR-PEACH_HVC-P2_sample

Sample to operate omron HVC-P2 on GR-PEACH.

Dependencies:   AsciiFont

Information

Please see here for Japanese version.
日本語版はこちらを参照ください。

What is this ?

This is a sample that runs OMRON HVC-P2 with GR-PEACH. In this sample, you can try following among the functions of HVC-P2 : Human Body Detection, Face Detection, Age Estimation, Gender Estimation, Expression Estimation and Face Recognition.
Both GR-PEACH and HVC-P2 use Renesas RZ/A1H included ARM® Cortex™-A9 processor.

/media/uploads/dkato/hvcp2_demo_img3.jpg

HVC-P2 (Human Vision Components B5T-007001) is a human-sensing component that recognizes people. It is an integrated module that is built into other device and provides both the OKAO Vision's ten types of image sensing and a camera module.
For details, please refer to the following link.

In the HVCApi folder of this sample, the code of the following link destination Sample Code "SampleCode_rev.2.0.2" is used. (You can download from "Product Information" -> "Sample Code" in the middle of the following page.)
http://www.omron.com/ecb/products/mobile/hvc_p2/

Constitution

  1. HVC-P2 x 1
  2. USBA-microUSB conversion cable x 2
  3. USBA-microUSB conversion adapter x 1
  4. GR-PEACH x 1
  5. 4.3inc LCD shield x 1

/media/uploads/dkato/composition_hvcp2_demo.jpg

/media/uploads/dkato/composition_hvcp2_demo_2.jpg

Please close JP3 of GR-PEACH.
/media/uploads/RyoheiHagimoto/usb.jpg

How to use

It starts when connecting the power supply USB cable. At startup, all functions are turned off. By pressing the button on the right of the screen you can switch the function on / off.

  • Function ON : orange or green
  • Function OFF : blue or gray

Only the FACE button changes to "FACE (blue) -> FACE (orange) -> RECOGNITION (green)". When FACE (blue), following buttons are gray and can not be operated : AGE, GENDER and EXPRESSION.
"Response time" at the bottom left of the screen indicates "image processing + USB transfer time". It is not pure image processing time.

Register Data (Face Recognition)

Set the FACE button to RECOGNITION (green), and touch the screen with one person on the screen to register the face. In this sample, face registration will record up to 10 people. Delete the old registrant when registering after 11 people. Registration information is stored in the RAM on the HVC-P2 side. It is discarded by power off and reset.

/media/uploads/dkato/hvcp2_demo_img2.jpg

Change parameters

When you press Config icon at the bottom right of the screen, the parameter setting screen is displayed. You can change threshold value, detection size and face angle parameters.

/media/uploads/dkato/hvcp2_demo_config_icon.jpg
/media/uploads/dkato/hvcp2_demo_config.jpg

Change transfer image size

By pressing USER_BUTTON0 on the back of the board, the image transfer size switches in the order of "160 x 120 -> 320 x 240 -> no image".
/media/uploads/dkato/gr-peach_switch2.jpg

HVC/STBLib/src/include/STBTypedefOutput.h@5:49a61433290a, 2017-09-05 (annotated)

Committer:
dkato
Date:
Tue Sep 05 10:01:51 2017 +0000
Revision:
5:49a61433290a
Add HVC sensing result stabilizing library

Who changed what in which revision?

UserRevisionLine numberNew contents of line
dkato 5:49a61433290a 1 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 2 /* Copyright(C) 2017 OMRON Corporation */
dkato 5:49a61433290a 3 /* */
dkato 5:49a61433290a 4 /* Licensed under the Apache License, Version 2.0 (the "License"); */
dkato 5:49a61433290a 5 /* you may not use this file except in compliance with the License. */
dkato 5:49a61433290a 6 /* You may obtain a copy of the License at */
dkato 5:49a61433290a 7 /* */
dkato 5:49a61433290a 8 /* http://www.apache.org/licenses/LICENSE-2.0 */
dkato 5:49a61433290a 9 /* */
dkato 5:49a61433290a 10 /* Unless required by applicable law or agreed to in writing, software */
dkato 5:49a61433290a 11 /* distributed under the License is distributed on an "AS IS" BASIS, */
dkato 5:49a61433290a 12 /* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. */
dkato 5:49a61433290a 13 /* See the License for the specific language governing permissions and */
dkato 5:49a61433290a 14 /* limitations under the License. */
dkato 5:49a61433290a 15 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 16
dkato 5:49a61433290a 17
dkato 5:49a61433290a 18 #ifndef STBTYPEDEF_H__
dkato 5:49a61433290a 19 #define STBTYPEDEF_H__
dkato 5:49a61433290a 20
dkato 5:49a61433290a 21 #ifndef VOID
dkato 5:49a61433290a 22 #define VOID void
dkato 5:49a61433290a 23 #endif
dkato 5:49a61433290a 24
dkato 5:49a61433290a 25 typedef signed char STB_INT8 ; /*8-bit signed integer*/
dkato 5:49a61433290a 26 typedef unsigned char STB_UINT8 ; /*8-bit unsigned integer*/
dkato 5:49a61433290a 27 typedef signed short STB_INT16 ; /*16-bit signed integer*/
dkato 5:49a61433290a 28 typedef unsigned short STB_UINT16 ; /*16-bit unsigned integer*/
dkato 5:49a61433290a 29 typedef int STB_INT32 ; /*32 bit signed integer*/
dkato 5:49a61433290a 30 typedef unsigned int STB_UINT32 ; /*32 bit unsigned integer*/
dkato 5:49a61433290a 31 typedef float STB_FLOAT32 ; /*32-bit floating point number*/
dkato 5:49a61433290a 32 typedef double STB_FLOAT64 ; /*64-bit floating point number*/
dkato 5:49a61433290a 33
dkato 5:49a61433290a 34
dkato 5:49a61433290a 35 typedef enum {
dkato 5:49a61433290a 36 STB_STATUS_NO_DATA = -1, /*No data : No data for the relevant person*/
dkato 5:49a61433290a 37 STB_STATUS_CALCULATING = 0, /* during stabilization : a number of data for relevant people aren't enough(a number of frames that relevant people are taken) */
dkato 5:49a61433290a 38 STB_STATUS_COMPLETE = 1, /*stabilization done : the frames which done stabilization*/
dkato 5:49a61433290a 39 STB_STATUS_FIXED = 2, /*stabilization fixed : already stabilization done, the results is fixed*/
dkato 5:49a61433290a 40 } STB_STATUS;/*Status of stabilization*/
dkato 5:49a61433290a 41
dkato 5:49a61433290a 42 #define STB_CONF_NO_DATA -1 /*No confidence(No data or in the case of stabilization time)*/
dkato 5:49a61433290a 43
dkato 5:49a61433290a 44 /* Expression */
dkato 5:49a61433290a 45 typedef enum {
dkato 5:49a61433290a 46 STB_EX_UNKNOWN = -1,
dkato 5:49a61433290a 47 STB_EX_NEUTRAL = 0,
dkato 5:49a61433290a 48 STB_EX_HAPPINESS,
dkato 5:49a61433290a 49 STB_EX_SURPRISE,
dkato 5:49a61433290a 50 STB_EX_ANGER,
dkato 5:49a61433290a 51 STB_EX_SADNESS,
dkato 5:49a61433290a 52 STB_EX_MAX
dkato 5:49a61433290a 53 }STB_EXPRESSION;
dkato 5:49a61433290a 54
dkato 5:49a61433290a 55 /*General purpose stabilization result structure*/
dkato 5:49a61433290a 56 typedef struct {
dkato 5:49a61433290a 57 STB_STATUS status;/* Stabilization status */
dkato 5:49a61433290a 58 STB_INT32 conf; /* Stabilization confidence */
dkato 5:49a61433290a 59 STB_INT32 value;
dkato 5:49a61433290a 60 } STB_RES;
dkato 5:49a61433290a 61
dkato 5:49a61433290a 62 /*result of Gaze estimation*/
dkato 5:49a61433290a 63 typedef struct {
dkato 5:49a61433290a 64 STB_STATUS status;/* Stabilization status */
dkato 5:49a61433290a 65 STB_INT32 conf; /* Stabilization confidence */
dkato 5:49a61433290a 66 STB_INT32 UD;
dkato 5:49a61433290a 67 STB_INT32 LR;
dkato 5:49a61433290a 68 } STB_GAZE;
dkato 5:49a61433290a 69
dkato 5:49a61433290a 70 /*Face direction result*/
dkato 5:49a61433290a 71 typedef struct {
dkato 5:49a61433290a 72 STB_STATUS status;/* Stabilization status */
dkato 5:49a61433290a 73 STB_INT32 conf; /* Stabilization confidence */
dkato 5:49a61433290a 74 STB_INT32 yaw;
dkato 5:49a61433290a 75 STB_INT32 pitch;
dkato 5:49a61433290a 76 STB_INT32 roll;
dkato 5:49a61433290a 77 } STB_DIR;
dkato 5:49a61433290a 78
dkato 5:49a61433290a 79 /*result of Blink estimation*/
dkato 5:49a61433290a 80 typedef struct {
dkato 5:49a61433290a 81 STB_STATUS status;/* Stabilization status */
dkato 5:49a61433290a 82 STB_INT32 ratioL;
dkato 5:49a61433290a 83 STB_INT32 ratioR;
dkato 5:49a61433290a 84 } STB_BLINK;
dkato 5:49a61433290a 85
dkato 5:49a61433290a 86 /*Detection position structure*/
dkato 5:49a61433290a 87 typedef struct {
dkato 5:49a61433290a 88 STB_UINT32 x;
dkato 5:49a61433290a 89 STB_UINT32 y;
dkato 5:49a61433290a 90 } STB_POS;
dkato 5:49a61433290a 91
dkato 5:49a61433290a 92 /*Face stabilization result structure*/
dkato 5:49a61433290a 93 typedef struct {
dkato 5:49a61433290a 94 STB_INT32 nDetectID;
dkato 5:49a61433290a 95 STB_INT32 nTrackingID;
dkato 5:49a61433290a 96 STB_POS center;
dkato 5:49a61433290a 97 STB_UINT32 nSize;
dkato 5:49a61433290a 98 STB_INT32 conf;
dkato 5:49a61433290a 99 STB_DIR direction;
dkato 5:49a61433290a 100 STB_RES age;
dkato 5:49a61433290a 101 STB_RES gender;
dkato 5:49a61433290a 102 STB_GAZE gaze;
dkato 5:49a61433290a 103 STB_BLINK blink;
dkato 5:49a61433290a 104 STB_RES expression;
dkato 5:49a61433290a 105 STB_RES recognition;
dkato 5:49a61433290a 106 } STB_FACE;
dkato 5:49a61433290a 107
dkato 5:49a61433290a 108 /*Human body result structure*/
dkato 5:49a61433290a 109 typedef struct {
dkato 5:49a61433290a 110 STB_INT32 nDetectID;
dkato 5:49a61433290a 111 STB_INT32 nTrackingID;
dkato 5:49a61433290a 112 STB_POS center;
dkato 5:49a61433290a 113 STB_UINT32 nSize;
dkato 5:49a61433290a 114 STB_INT32 conf;
dkato 5:49a61433290a 115 } STB_BODY;
dkato 5:49a61433290a 116
dkato 5:49a61433290a 117
dkato 5:49a61433290a 118
dkato 5:49a61433290a 119 #endif /* STBTYPEDEF_H__ */