Renesas / Mbed OS GR-PEACH_HVC-P2_sample

Sample to operate omron HVC-P2 on GR-PEACH.

Dependencies:   AsciiFont

Information

Please see here for Japanese version.
日本語版はこちらを参照ください。

What is this ?

This is a sample that runs OMRON HVC-P2 with GR-PEACH. In this sample, you can try following among the functions of HVC-P2 : Human Body Detection, Face Detection, Age Estimation, Gender Estimation, Expression Estimation and Face Recognition.
Both GR-PEACH and HVC-P2 use Renesas RZ/A1H included ARM® Cortex™-A9 processor.

/media/uploads/dkato/hvcp2_demo_img3.jpg

HVC-P2 (Human Vision Components B5T-007001) is a human-sensing component that recognizes people. It is an integrated module that is built into other device and provides both the OKAO Vision's ten types of image sensing and a camera module.
For details, please refer to the following link.

In the HVCApi folder of this sample, the code of the following link destination Sample Code "SampleCode_rev.2.0.2" is used. (You can download from "Product Information" -> "Sample Code" in the middle of the following page.)
http://www.omron.com/ecb/products/mobile/hvc_p2/

Constitution

  1. HVC-P2 x 1
  2. USBA-microUSB conversion cable x 2
  3. USBA-microUSB conversion adapter x 1
  4. GR-PEACH x 1
  5. 4.3inc LCD shield x 1

/media/uploads/dkato/composition_hvcp2_demo.jpg

/media/uploads/dkato/composition_hvcp2_demo_2.jpg

Please close JP3 of GR-PEACH.
/media/uploads/RyoheiHagimoto/usb.jpg

How to use

It starts when connecting the power supply USB cable. At startup, all functions are turned off. By pressing the button on the right of the screen you can switch the function on / off.

  • Function ON : orange or green
  • Function OFF : blue or gray

Only the FACE button changes to "FACE (blue) -> FACE (orange) -> RECOGNITION (green)". When FACE (blue), following buttons are gray and can not be operated : AGE, GENDER and EXPRESSION.
"Response time" at the bottom left of the screen indicates "image processing + USB transfer time". It is not pure image processing time.

Register Data (Face Recognition)

Set the FACE button to RECOGNITION (green), and touch the screen with one person on the screen to register the face. In this sample, face registration will record up to 10 people. Delete the old registrant when registering after 11 people. Registration information is stored in the RAM on the HVC-P2 side. It is discarded by power off and reset.

/media/uploads/dkato/hvcp2_demo_img2.jpg

Change parameters

When you press Config icon at the bottom right of the screen, the parameter setting screen is displayed. You can change threshold value, detection size and face angle parameters.

/media/uploads/dkato/hvcp2_demo_config_icon.jpg
/media/uploads/dkato/hvcp2_demo_config.jpg

Change transfer image size

By pressing USER_BUTTON0 on the back of the board, the image transfer size switches in the order of "160 x 120 -> 320 x 240 -> no image".
/media/uploads/dkato/gr-peach_switch2.jpg

HVC/STBLib/src/STB_FaceRecognition/FrInterface.h@5:49a61433290a, 2017-09-05 (annotated)

Committer:
dkato
Date:
Tue Sep 05 10:01:51 2017 +0000
Revision:
5:49a61433290a
Add HVC sensing result stabilizing library

Who changed what in which revision?

UserRevisionLine numberNew contents of line
dkato 5:49a61433290a 1 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 2 /* Copyright(C) 2017 OMRON Corporation */
dkato 5:49a61433290a 3 /* */
dkato 5:49a61433290a 4 /* Licensed under the Apache License, Version 2.0 (the "License"); */
dkato 5:49a61433290a 5 /* you may not use this file except in compliance with the License. */
dkato 5:49a61433290a 6 /* You may obtain a copy of the License at */
dkato 5:49a61433290a 7 /* */
dkato 5:49a61433290a 8 /* http://www.apache.org/licenses/LICENSE-2.0 */
dkato 5:49a61433290a 9 /* */
dkato 5:49a61433290a 10 /* Unless required by applicable law or agreed to in writing, software */
dkato 5:49a61433290a 11 /* distributed under the License is distributed on an "AS IS" BASIS, */
dkato 5:49a61433290a 12 /* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. */
dkato 5:49a61433290a 13 /* See the License for the specific language governing permissions and */
dkato 5:49a61433290a 14 /* limitations under the License. */
dkato 5:49a61433290a 15 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 16
dkato 5:49a61433290a 17 #if !defined( _INTERFACE_H_ )
dkato 5:49a61433290a 18 #define _INTERFACE_H_
dkato 5:49a61433290a 19
dkato 5:49a61433290a 20 #include "STBFrTypedef.h"
dkato 5:49a61433290a 21 #include "STBCommonDef.h"
dkato 5:49a61433290a 22 #include "STBCommonType.h"
dkato 5:49a61433290a 23 #include "STBFrValidValue.h"
dkato 5:49a61433290a 24
dkato 5:49a61433290a 25 #ifdef __cplusplus
dkato 5:49a61433290a 26 extern "C" {
dkato 5:49a61433290a 27 #endif
dkato 5:49a61433290a 28
dkato 5:49a61433290a 29
dkato 5:49a61433290a 30 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 31 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 32 /////////// Define //////////////
dkato 5:49a61433290a 33 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 34 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 35
dkato 5:49a61433290a 36
dkato 5:49a61433290a 37 #define STB_FR_BACK_MAX 20 /* refer to past "STB_BACK_MAX" frames of results */
dkato 5:49a61433290a 38
dkato 5:49a61433290a 39 #define STB_FR_TRA_CNT_MAX 35
dkato 5:49a61433290a 40
dkato 5:49a61433290a 41 #define STB_FR_INVALID_UID -999
dkato 5:49a61433290a 42
dkato 5:49a61433290a 43 #define STB_FR_DIR_MIN_UD_INI -15
dkato 5:49a61433290a 44 #define STB_FR_DIR_MIN_UD_MIN -90
dkato 5:49a61433290a 45 #define STB_FR_DIR_MIN_UD_MAX 90
dkato 5:49a61433290a 46
dkato 5:49a61433290a 47 #define STB_FR_DIR_MAX_UD_INI 20
dkato 5:49a61433290a 48 #define STB_FR_DIR_MAX_UD_MIN -90
dkato 5:49a61433290a 49 #define STB_FR_DIR_MAX_UD_MAX 90
dkato 5:49a61433290a 50
dkato 5:49a61433290a 51 #define STB_FR_DIR_MIN_LR_INI -30
dkato 5:49a61433290a 52 #define STB_FR_DIR_MIN_LR_MIN -90
dkato 5:49a61433290a 53 #define STB_FR_DIR_MIN_LR_MAX 90
dkato 5:49a61433290a 54
dkato 5:49a61433290a 55 #define STB_FR_DIR_MAX_LR_INI 30
dkato 5:49a61433290a 56 #define STB_FR_DIR_MAX_LR_MIN -90
dkato 5:49a61433290a 57 #define STB_FR_DIR_MAX_LR_MAX 90
dkato 5:49a61433290a 58
dkato 5:49a61433290a 59 #define STB_FR_DIR_THR_INI 300
dkato 5:49a61433290a 60 #define STB_FR_DIR_THR_MIN 0
dkato 5:49a61433290a 61 #define STB_FR_DIR_THR_MAX 1000
dkato 5:49a61433290a 62
dkato 5:49a61433290a 63 #define STB_FR_FRAME_CNT_INI 5
dkato 5:49a61433290a 64 #define STB_FR_FRAME_CNT_MIN 0
dkato 5:49a61433290a 65 #define STB_FR_FRAME_CNT_MAX 20
dkato 5:49a61433290a 66
dkato 5:49a61433290a 67 #define STB_FR_FRAME_RATIO_INI 60
dkato 5:49a61433290a 68 #define STB_FR_FRAME_RATIO_MIN 0
dkato 5:49a61433290a 69 #define STB_FR_FRAME_RATIO_MAX 100
dkato 5:49a61433290a 70
dkato 5:49a61433290a 71 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 72 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 73 /////////// Struct //////////////
dkato 5:49a61433290a 74 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 75 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 76 typedef struct tagFRHANDLE {
dkato 5:49a61433290a 77
dkato 5:49a61433290a 78 STB_INT8 *frPtr ;
dkato 5:49a61433290a 79
dkato 5:49a61433290a 80 /* param */
dkato 5:49a61433290a 81 STB_INT32 frCntMax ;//Maximum number of tracking people
dkato 5:49a61433290a 82 STB_INT32 frFaceDirUDMax ;//The face on top/down allowable range max.
dkato 5:49a61433290a 83 STB_INT32 frFaceDirUDMin ;//The face on top/down allowable range min.
dkato 5:49a61433290a 84 STB_INT32 frFaceDirLRMax ;//The face on left /right side allowable range max.
dkato 5:49a61433290a 85 STB_INT32 frFaceDirLRMin ;//The face on left /right side allowable range min.
dkato 5:49a61433290a 86 STB_INT32 frFaceDirThr ;//If the confidence of Face direction estimation doesn't exceed the reference value, the recognition result isn't trusted.
dkato 5:49a61433290a 87 STB_INT32 frFrameCount ;
dkato 5:49a61433290a 88 STB_INT32 frFrameRatio ;
dkato 5:49a61433290a 89 /* FR_Face */
dkato 5:49a61433290a 90 STB_FR_DET frDet ;//Present data before the stabilization(input).
dkato 5:49a61433290a 91 STB_FR_DET *frDetRec ;//past data before the stabilization
dkato 5:49a61433290a 92 STB_FR_RES frRes ;//present data after the stabilization(output)
dkato 5:49a61433290a 93
dkato 5:49a61433290a 94 } *FRHANDLE;
dkato 5:49a61433290a 95
dkato 5:49a61433290a 96
dkato 5:49a61433290a 97 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 98 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 99 /////////// Func //////////////
dkato 5:49a61433290a 100 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 101 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 102 FRHANDLE FrCreateHandle ( const STB_INT32 nTraCntMax );
dkato 5:49a61433290a 103 STB_INT32 FrDeleteHandle ( FRHANDLE handle);
dkato 5:49a61433290a 104 STB_INT32 FrSetDetect ( FRHANDLE handle,const STB_FR_DET *stbPeDet);
dkato 5:49a61433290a 105 STB_INT32 FrExecute ( FRHANDLE handle);
dkato 5:49a61433290a 106 STB_INT32 FrClear ( FRHANDLE handle );
dkato 5:49a61433290a 107 STB_INT32 FrGetResult ( FRHANDLE handle , STB_FR_RES* peResult);
dkato 5:49a61433290a 108
dkato 5:49a61433290a 109 STB_INT32 FrSetFaceDirMinMax( FRHANDLE handle , STB_INT32 nMinUDAngle , STB_INT32 nMaxUDAngle ,STB_INT32 nMinLRAngle , STB_INT32 nMaxLRAngle);
dkato 5:49a61433290a 110 STB_INT32 FrGetFaceDirMinMax( FRHANDLE handle , STB_INT32 *pnMinUDAngle , STB_INT32 *pnMaxUDAngle ,STB_INT32 *pnMinLRAngle, STB_INT32 *pnMaxLRAngle );
dkato 5:49a61433290a 111 STB_INT32 FrSetFaceDirThreshold ( FRHANDLE handle , STB_INT32 threshold );
dkato 5:49a61433290a 112 STB_INT32 FrGetFaceDirThreshold ( FRHANDLE handle , STB_INT32* threshold );
dkato 5:49a61433290a 113 STB_INT32 FrSetFrameCount ( FRHANDLE handle , STB_INT32 nFrameCount );
dkato 5:49a61433290a 114 STB_INT32 FrGetFrameCount ( FRHANDLE handle , STB_INT32* nFrameCount );
dkato 5:49a61433290a 115 STB_INT32 FrSetMinRatio ( FRHANDLE handle , STB_INT32 nMinRatio );
dkato 5:49a61433290a 116 STB_INT32 FrGetMinRatio ( FRHANDLE handle , STB_INT32* nMinRatio );
dkato 5:49a61433290a 117 #ifdef __cplusplus
dkato 5:49a61433290a 118 }
dkato 5:49a61433290a 119 #endif
dkato 5:49a61433290a 120
dkato 5:49a61433290a 121 #endif