Renesas / Mbed OS GR-PEACH_HVC-P2_sample

Sample to operate omron HVC-P2 on GR-PEACH.

Dependencies:   AsciiFont

Information

Please see here for Japanese version.
日本語版はこちらを参照ください。

What is this ?

This is a sample that runs OMRON HVC-P2 with GR-PEACH. In this sample, you can try following among the functions of HVC-P2 : Human Body Detection, Face Detection, Age Estimation, Gender Estimation, Expression Estimation and Face Recognition.
Both GR-PEACH and HVC-P2 use Renesas RZ/A1H included ARM® Cortex™-A9 processor.

/media/uploads/dkato/hvcp2_demo_img3.jpg

HVC-P2 (Human Vision Components B5T-007001) is a human-sensing component that recognizes people. It is an integrated module that is built into other device and provides both the OKAO Vision's ten types of image sensing and a camera module.
For details, please refer to the following link.

In the HVCApi folder of this sample, the code of the following link destination Sample Code "SampleCode_rev.2.0.2" is used. (You can download from "Product Information" -> "Sample Code" in the middle of the following page.)
http://www.omron.com/ecb/products/mobile/hvc_p2/

Constitution

  1. HVC-P2 x 1
  2. USBA-microUSB conversion cable x 2
  3. USBA-microUSB conversion adapter x 1
  4. GR-PEACH x 1
  5. 4.3inc LCD shield x 1

/media/uploads/dkato/composition_hvcp2_demo.jpg

/media/uploads/dkato/composition_hvcp2_demo_2.jpg

Please close JP3 of GR-PEACH.
/media/uploads/RyoheiHagimoto/usb.jpg

How to use

It starts when connecting the power supply USB cable. At startup, all functions are turned off. By pressing the button on the right of the screen you can switch the function on / off.

  • Function ON : orange or green
  • Function OFF : blue or gray

Only the FACE button changes to "FACE (blue) -> FACE (orange) -> RECOGNITION (green)". When FACE (blue), following buttons are gray and can not be operated : AGE, GENDER and EXPRESSION.
"Response time" at the bottom left of the screen indicates "image processing + USB transfer time". It is not pure image processing time.

Register Data (Face Recognition)

Set the FACE button to RECOGNITION (green), and touch the screen with one person on the screen to register the face. In this sample, face registration will record up to 10 people. Delete the old registrant when registering after 11 people. Registration information is stored in the RAM on the HVC-P2 side. It is discarded by power off and reset.

/media/uploads/dkato/hvcp2_demo_img2.jpg

Change parameters

When you press Config icon at the bottom right of the screen, the parameter setting screen is displayed. You can change threshold value, detection size and face angle parameters.

/media/uploads/dkato/hvcp2_demo_config_icon.jpg
/media/uploads/dkato/hvcp2_demo_config.jpg

Change transfer image size

By pressing USER_BUTTON0 on the back of the board, the image transfer size switches in the order of "160 x 120 -> 320 x 240 -> no image".
/media/uploads/dkato/gr-peach_switch2.jpg

HVC/STBLib/src/STB_Tracker/TrInterface.h@5:49a61433290a, 2017-09-05 (annotated)

Committer:
dkato
Date:
Tue Sep 05 10:01:51 2017 +0000
Revision:
5:49a61433290a
Add HVC sensing result stabilizing library

Who changed what in which revision?

UserRevisionLine numberNew contents of line
dkato 5:49a61433290a 1 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 2 /* Copyright(C) 2017 OMRON Corporation */
dkato 5:49a61433290a 3 /* */
dkato 5:49a61433290a 4 /* Licensed under the Apache License, Version 2.0 (the "License"); */
dkato 5:49a61433290a 5 /* you may not use this file except in compliance with the License. */
dkato 5:49a61433290a 6 /* You may obtain a copy of the License at */
dkato 5:49a61433290a 7 /* */
dkato 5:49a61433290a 8 /* http://www.apache.org/licenses/LICENSE-2.0 */
dkato 5:49a61433290a 9 /* */
dkato 5:49a61433290a 10 /* Unless required by applicable law or agreed to in writing, software */
dkato 5:49a61433290a 11 /* distributed under the License is distributed on an "AS IS" BASIS, */
dkato 5:49a61433290a 12 /* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. */
dkato 5:49a61433290a 13 /* See the License for the specific language governing permissions and */
dkato 5:49a61433290a 14 /* limitations under the License. */
dkato 5:49a61433290a 15 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 16
dkato 5:49a61433290a 17 #if !defined( _INTERFACE_H_ )
dkato 5:49a61433290a 18 #define _INTERFACE_H_
dkato 5:49a61433290a 19 #include "STBTrTypedef.h"
dkato 5:49a61433290a 20 #include "STBCommonDef.h"
dkato 5:49a61433290a 21 #include "STBCommonType.h"
dkato 5:49a61433290a 22 #include "STBTrValidValue.h"
dkato 5:49a61433290a 23
dkato 5:49a61433290a 24 #ifdef __cplusplus
dkato 5:49a61433290a 25 extern "C" {
dkato 5:49a61433290a 26 #endif
dkato 5:49a61433290a 27
dkato 5:49a61433290a 28
dkato 5:49a61433290a 29 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 30 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 31 /////////// Define //////////////
dkato 5:49a61433290a 32 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 33 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 34
dkato 5:49a61433290a 35 /* refer to past "STB_BACK_MAX-1" frames of results */
dkato 5:49a61433290a 36 #define STB_TR_BACK_MAX 2
dkato 5:49a61433290a 37
dkato 5:49a61433290a 38 #define STB_TR_DET_CNT_MAX 35
dkato 5:49a61433290a 39 #define STB_TR_TRA_CNT_MAX 35
dkato 5:49a61433290a 40
dkato 5:49a61433290a 41 //If the face isn't find out during tracking, set until how many frames can look for it.
dkato 5:49a61433290a 42 //In the case of tracking failed with a specified number of frames consecutively, end of tracking as the face lost.
dkato 5:49a61433290a 43 #define STB_TR_INI_RETRY 2
dkato 5:49a61433290a 44 #define STB_TR_MIN_RETRY 0
dkato 5:49a61433290a 45 #define STB_TR_MAX_RETRY 300
dkato 5:49a61433290a 46
dkato 5:49a61433290a 47 //Specifies settings %
dkato 5:49a61433290a 48 //For example, about the percentage of detected position change, setting the value to 30(<- initialize value)
dkato 5:49a61433290a 49 //in the case of position change under 30 percentage from the previous frame, output detected position of the previous frame
dkato 5:49a61433290a 50 //When it exceeds 30%, the detection position coordinate is output as it is.
dkato 5:49a61433290a 51 #define STB_TR_INI_STEADINESS_POS 30
dkato 5:49a61433290a 52 #define STB_TR_MIN_STEADINESS_POS 0
dkato 5:49a61433290a 53 #define STB_TR_MAX_STEADINESS_POS 100
dkato 5:49a61433290a 54
dkato 5:49a61433290a 55 //Specifies settings %
dkato 5:49a61433290a 56 //In the case of the percentage of detection size change setting to 30(<- initialize value)
dkato 5:49a61433290a 57 //in the case of size change under 30 percentage from the previous frame, output detected size of the previous frame
dkato 5:49a61433290a 58 //When it exceeds 30%, the detection size is output as it is.
dkato 5:49a61433290a 59 #define STB_TR_INI_STEADINESS_SIZE 30
dkato 5:49a61433290a 60 #define STB_TR_MIN_STEADINESS_SIZE 0
dkato 5:49a61433290a 61 #define STB_TR_MAX_STEADINESS_SIZE 100
dkato 5:49a61433290a 62
dkato 5:49a61433290a 63
dkato 5:49a61433290a 64 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 65 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 66 /////////// Struct //////////////
dkato 5:49a61433290a 67 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 68 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 69
dkato 5:49a61433290a 70
dkato 5:49a61433290a 71 typedef struct{
dkato 5:49a61433290a 72 STB_INT32 cnt ;
dkato 5:49a61433290a 73 STB_INT32 *nDetID ; /*previous detected result ID*/
dkato 5:49a61433290a 74 STB_INT32 *nTraID ; /*Tracking ID*/
dkato 5:49a61433290a 75 STB_INT32 *posX ; /* Center x-coordinate */
dkato 5:49a61433290a 76 STB_INT32 *posY ; /* Center y-coordinate */
dkato 5:49a61433290a 77 STB_INT32 *size ; /* Size */
dkato 5:49a61433290a 78 STB_INT32 *conf ; /* Degree of confidence */
dkato 5:49a61433290a 79 STB_INT32 *retryN ; /*Continuous retry count*/
dkato 5:49a61433290a 80 }ROI_SYS;
dkato 5:49a61433290a 81
dkato 5:49a61433290a 82
dkato 5:49a61433290a 83 /*---------------------------------------------------------------------------*/
dkato 5:49a61433290a 84 typedef struct tagPEHANDLE {
dkato 5:49a61433290a 85 STB_INT8 *trPtr ;
dkato 5:49a61433290a 86 STB_INT32 detCntMax ;//Maximum of detected people
dkato 5:49a61433290a 87 STB_INT32 traCntMax ;//Maximum number of tracking people
dkato 5:49a61433290a 88 STB_INT32 retryCnt ;//Retry count
dkato 5:49a61433290a 89 STB_INT32 stedPos ;//stabilization parameter(position)
dkato 5:49a61433290a 90 STB_INT32 stedSize ;//stabilization parameter(size)
dkato 5:49a61433290a 91 STB_INT32 fcCntAcc ;//Number of faces (cumulative)
dkato 5:49a61433290a 92 STB_INT32 bdCntAcc ;//a number of human bodies(cumulative)
dkato 5:49a61433290a 93 STB_TR_DET *stbTrDet ;//Present data before the stabilization(input).
dkato 5:49a61433290a 94 ROI_SYS *fcRec ;//past data
dkato 5:49a61433290a 95 ROI_SYS *bdRec ;//past data
dkato 5:49a61433290a 96 STB_TR_RES_FACES *resFaces ;//present data after the stabilization(output)
dkato 5:49a61433290a 97 STB_TR_RES_BODYS *resBodys ;//present data after the stabilization(output)
dkato 5:49a61433290a 98 STB_INT32 *wIdPreCur ;
dkato 5:49a61433290a 99 STB_INT32 *wIdCurPre ;
dkato 5:49a61433290a 100 STB_INT32 *wDstTbl ;
dkato 5:49a61433290a 101 STBExecFlg *execFlg ;
dkato 5:49a61433290a 102 ROI_SYS *wRoi ;
dkato 5:49a61433290a 103 } *TRHANDLE;
dkato 5:49a61433290a 104
dkato 5:49a61433290a 105 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 106 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 107 /////////// Func //////////////
dkato 5:49a61433290a 108 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 109 //////////////////////////////////////////////////////////////////////////////////
dkato 5:49a61433290a 110
dkato 5:49a61433290a 111 TRHANDLE TrCreateHandle ( const STBExecFlg* execFlg ,const STB_INT32 nDetCntMax, const STB_INT32 nTraCntMax );
dkato 5:49a61433290a 112 STB_INT32 TrDeleteHandle ( TRHANDLE handle);
dkato 5:49a61433290a 113 STB_INT32 TrSetDetect ( TRHANDLE handle , const STB_TR_DET *stbTrDet);
dkato 5:49a61433290a 114 STB_INT32 TrExecute ( TRHANDLE handle);
dkato 5:49a61433290a 115 STB_INT32 TrClear ( TRHANDLE handle);
dkato 5:49a61433290a 116 STB_INT32 TrGetResult ( TRHANDLE handle , STB_TR_RES_FACES* fcResult,STB_TR_RES_BODYS* bdResult);
dkato 5:49a61433290a 117 STB_INT32 TrSetRetryCount ( TRHANDLE handle , STB_INT32 nRetryCount );
dkato 5:49a61433290a 118 STB_INT32 TrGetRetryCount ( TRHANDLE handle , STB_INT32* nRetryCount );
dkato 5:49a61433290a 119 STB_INT32 TrSetStedinessParam ( TRHANDLE handle , STB_INT32 nStedinessPos , STB_INT32 nStedinessSize );
dkato 5:49a61433290a 120 STB_INT32 TrGetStedinessParam ( TRHANDLE handle , STB_INT32* nStedinessPos , STB_INT32* nStedinessSize );
dkato 5:49a61433290a 121
dkato 5:49a61433290a 122
dkato 5:49a61433290a 123
dkato 5:49a61433290a 124 #ifdef __cplusplus
dkato 5:49a61433290a 125 }
dkato 5:49a61433290a 126 #endif
dkato 5:49a61433290a 127
dkato 5:49a61433290a 128 #endif