Sample to operate omron HVC-P2 on GR-PEACH.

Dependencies:   AsciiFont

Information

Please see here for Japanese version.
日本語版はこちらを参照ください。

What is this ?

This is a sample that runs OMRON HVC-P2 with GR-PEACH. In this sample, you can try following among the functions of HVC-P2 : Human Body Detection, Face Detection, Age Estimation, Gender Estimation, Expression Estimation and Face Recognition.
Both GR-PEACH and HVC-P2 use Renesas RZ/A1H included ARM® Cortex™-A9 processor.

/media/uploads/dkato/hvcp2_demo_img3.jpg

HVC-P2 (Human Vision Components B5T-007001) is a human-sensing component that recognizes people. It is an integrated module that is built into other device and provides both the OKAO Vision's ten types of image sensing and a camera module.
For details, please refer to the following link.

In the HVCApi folder of this sample, the code of the following link destination Sample Code "SampleCode_rev.2.0.2" is used. (You can download from "Product Information" -> "Sample Code" in the middle of the following page.)
http://www.omron.com/ecb/products/mobile/hvc_p2/

Constitution

  1. HVC-P2 x 1
  2. USBA-microUSB conversion cable x 2
  3. USBA-microUSB conversion adapter x 1
  4. GR-PEACH x 1
  5. 4.3inc LCD shield x 1

/media/uploads/dkato/composition_hvcp2_demo.jpg

/media/uploads/dkato/composition_hvcp2_demo_2.jpg

Please close JP3 of GR-PEACH.
/media/uploads/RyoheiHagimoto/usb.jpg

How to use

It starts when connecting the power supply USB cable. At startup, all functions are turned off. By pressing the button on the right of the screen you can switch the function on / off.

  • Function ON : orange or green
  • Function OFF : blue or gray

Only the FACE button changes to "FACE (blue) -> FACE (orange) -> RECOGNITION (green)". When FACE (blue), following buttons are gray and can not be operated : AGE, GENDER and EXPRESSION.
"Response time" at the bottom left of the screen indicates "image processing + USB transfer time". It is not pure image processing time.

Register Data (Face Recognition)

Set the FACE button to RECOGNITION (green), and touch the screen with one person on the screen to register the face. In this sample, face registration will record up to 10 people. Delete the old registrant when registering after 11 people. Registration information is stored in the RAM on the HVC-P2 side. It is discarded by power off and reset.

/media/uploads/dkato/hvcp2_demo_img2.jpg

Change parameters

When you press Config icon at the bottom right of the screen, the parameter setting screen is displayed. You can change threshold value, detection size and face angle parameters.

/media/uploads/dkato/hvcp2_demo_config_icon.jpg
/media/uploads/dkato/hvcp2_demo_config.jpg

Change transfer image size

By pressing USER_BUTTON0 on the back of the board, the image transfer size switches in the order of "160 x 120 -> 320 x 240 -> no image".
/media/uploads/dkato/gr-peach_switch2.jpg

HVC/STBLib/src/STB_Tracker/TrInterface.h

Committer:
dkato
Date:
2017-09-05
Revision:
5:49a61433290a

File content as of revision 5:49a61433290a:

/*---------------------------------------------------------------------------*/
/* Copyright(C)  2017  OMRON Corporation                                     */
/*                                                                           */
/* Licensed under the Apache License, Version 2.0 (the "License");           */
/* you may not use this file except in compliance with the License.          */
/* You may obtain a copy of the License at                                   */
/*                                                                           */
/*     http://www.apache.org/licenses/LICENSE-2.0                            */
/*                                                                           */
/* Unless required by applicable law or agreed to in writing, software       */
/* distributed under the License is distributed on an "AS IS" BASIS,         */
/* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.  */
/* See the License for the specific language governing permissions and       */
/* limitations under the License.                                            */
/*---------------------------------------------------------------------------*/

#if !defined( _INTERFACE_H_ )
#define _INTERFACE_H_
#include "STBTrTypedef.h"
#include "STBCommonDef.h"
#include "STBCommonType.h"
#include "STBTrValidValue.h"

#ifdef  __cplusplus
extern "C" {
#endif


//////////////////////////////////////////////////////////////////////////////////
//////////////////////////////////////////////////////////////////////////////////
///////////                            Define                            //////////////
//////////////////////////////////////////////////////////////////////////////////
//////////////////////////////////////////////////////////////////////////////////
    
/* refer to past "STB_BACK_MAX-1" frames of results */
#define STB_TR_BACK_MAX 2 

#define STB_TR_DET_CNT_MAX 35 
#define STB_TR_TRA_CNT_MAX 35

//If the face isn't find out during tracking, set until how many frames can look for it.
//In the case of tracking failed with a specified number of frames consecutively, end of tracking as the face lost.
#define STB_TR_INI_RETRY        2 
#define STB_TR_MIN_RETRY        0 
#define STB_TR_MAX_RETRY        300 

//Specifies settings %
//For example, about the percentage of detected position change, setting the value to 30(<- initialize value)
//in the case of position change under 30 percentage from the previous frame, output detected position of the previous frame
//When it exceeds 30%, the detection position coordinate is output as it is.
#define STB_TR_INI_STEADINESS_POS        30
#define STB_TR_MIN_STEADINESS_POS          0
#define STB_TR_MAX_STEADINESS_POS        100

//Specifies settings %
//In the case of  the percentage of detection size change setting to 30(<- initialize value)
//in the case of size change under 30 percentage from the previous frame, output detected size of the previous frame
//When it exceeds 30%, the detection size is output as it is.
#define STB_TR_INI_STEADINESS_SIZE        30
#define STB_TR_MIN_STEADINESS_SIZE        0
#define STB_TR_MAX_STEADINESS_SIZE        100


//////////////////////////////////////////////////////////////////////////////////    
//////////////////////////////////////////////////////////////////////////////////
///////////                            Struct                            //////////////
//////////////////////////////////////////////////////////////////////////////////
//////////////////////////////////////////////////////////////////////////////////    


typedef struct{
    STB_INT32    cnt            ;
    STB_INT32   *nDetID        ; /*previous detected result ID*/
    STB_INT32   *nTraID        ; /*Tracking ID*/
    STB_INT32   *posX        ; /* Center x-coordinate    */
    STB_INT32   *posY        ; /* Center y-coordinate    */
    STB_INT32   *size        ; /* Size                    */
    STB_INT32   *conf        ; /* Degree of confidence    */
    STB_INT32   *retryN        ; /*Continuous retry count*/
}ROI_SYS;


/*---------------------------------------------------------------------------*/
typedef struct tagPEHANDLE {
    STB_INT8            *trPtr            ;
    STB_INT32            detCntMax        ;//Maximum of detected people
    STB_INT32            traCntMax        ;//Maximum number of tracking people
    STB_INT32            retryCnt        ;//Retry count
    STB_INT32            stedPos            ;//stabilization parameter(position)
    STB_INT32            stedSize        ;//stabilization parameter(size)
    STB_INT32            fcCntAcc        ;//Number of faces (cumulative)
    STB_INT32            bdCntAcc        ;//a number of human bodies(cumulative)
    STB_TR_DET            *stbTrDet        ;//Present data before the stabilization(input).
    ROI_SYS                *fcRec            ;//past data
    ROI_SYS                *bdRec            ;//past data
    STB_TR_RES_FACES    *resFaces        ;//present data after the stabilization(output)
    STB_TR_RES_BODYS    *resBodys        ;//present data after the stabilization(output)
    STB_INT32            *wIdPreCur        ;
    STB_INT32            *wIdCurPre        ;
    STB_INT32            *wDstTbl        ;
    STBExecFlg            *execFlg        ;
    ROI_SYS                *wRoi            ;
} *TRHANDLE;

//////////////////////////////////////////////////////////////////////////////////    
//////////////////////////////////////////////////////////////////////////////////
///////////                            Func                            //////////////
//////////////////////////////////////////////////////////////////////////////////
//////////////////////////////////////////////////////////////////////////////////

TRHANDLE    TrCreateHandle        ( const STBExecFlg* execFlg ,const STB_INT32 nDetCntMax, const STB_INT32 nTraCntMax );
STB_INT32    TrDeleteHandle        ( TRHANDLE handle);
STB_INT32    TrSetDetect            ( TRHANDLE handle , const STB_TR_DET *stbTrDet);
STB_INT32    TrExecute            ( TRHANDLE handle);
STB_INT32    TrClear                ( TRHANDLE handle);
STB_INT32    TrGetResult            ( TRHANDLE handle , STB_TR_RES_FACES* fcResult,STB_TR_RES_BODYS* bdResult);
STB_INT32    TrSetRetryCount        ( TRHANDLE handle , STB_INT32  nRetryCount    );
STB_INT32    TrGetRetryCount        ( TRHANDLE handle , STB_INT32* nRetryCount    );
STB_INT32    TrSetStedinessParam    ( TRHANDLE handle , STB_INT32  nStedinessPos , STB_INT32  nStedinessSize );
STB_INT32    TrGetStedinessParam    ( TRHANDLE handle , STB_INT32* nStedinessPos , STB_INT32* nStedinessSize );



#ifdef  __cplusplus
}
#endif

#endif