GR-PEACH_HVC-P2_sample - Sample to operate omron HVC-P2 on GR-PEACH.

Renesas » Code » GR-PEACH_HVC-P2_sample

Renesas / Mbed OS GR-PEACH_HVC-P2_sample

Sample to operate omron HVC-P2 on GR-PEACH.

Dependencies: AsciiFont

Information

Please see here for Japanese version.
日本語版はこちらを参照ください。

What is this ?

This is a sample that runs OMRON HVC-P2 with GR-PEACH. In this sample, you can try following among the functions of HVC-P2 : Human Body Detection, Face Detection, Age Estimation, Gender Estimation, Expression Estimation and Face Recognition.
Both GR-PEACH and HVC-P2 use Renesas RZ/A1H included ARM® Cortex™-A9 processor.

/media/uploads/dkato/hvcp2_demo_img3.jpg

HVC-P2 (Human Vision Components B5T-007001) is a human-sensing component that recognizes people. It is an integrated module that is built into other device and provides both the OKAO Vision's ten types of image sensing and a camera module.
For details, please refer to the following link.

SENSING EGG PROJECT > HVC-P2 (In Japanese)
https://plus-sensing.omron.co.jp/egg-project/product/hvc-p2/
HVC-P2 (Human Vision Components B5T-007001)
http://www.omron.com/ecb/products/mobile/hvc_p2/
OKAO Vision
https://plus-sensing.omron.com/technology/index.html

In the HVCApi folder of this sample, the code of the following link destination Sample Code "SampleCode_rev.2.0.2" is used. (You can download from "Product Information" -> "Sample Code" in the middle of the following page.)
http://www.omron.com/ecb/products/mobile/hvc_p2/

Constitution

HVC-P2 x 1
USBA-microUSB conversion cable x 2
USBA-microUSB conversion adapter x 1
GR-PEACH x 1
4.3inc LCD shield x 1

/media/uploads/dkato/composition_hvcp2_demo.jpg

/media/uploads/dkato/composition_hvcp2_demo_2.jpg

Please close JP3 of GR-PEACH.
/media/uploads/RyoheiHagimoto/usb.jpg

How to use

It starts when connecting the power supply USB cable. At startup, all functions are turned off. By pressing the button on the right of the screen you can switch the function on / off.

Function ON : orange or green
Function OFF : blue or gray

Only the FACE button changes to "FACE (blue) -> FACE (orange) -> RECOGNITION (green)". When FACE (blue), following buttons are gray and can not be operated : AGE, GENDER and EXPRESSION.
"Response time" at the bottom left of the screen indicates "image processing + USB transfer time". It is not pure image processing time.

Register Data (Face Recognition)

Set the FACE button to RECOGNITION (green), and touch the screen with one person on the screen to register the face. In this sample, face registration will record up to 10 people. Delete the old registrant when registering after 11 people. Registration information is stored in the RAM on the HVC-P2 side. It is discarded by power off and reset.

/media/uploads/dkato/hvcp2_demo_img2.jpg

Change parameters

When you press Config icon at the bottom right of the screen, the parameter setting screen is displayed. You can change threshold value, detection size and face angle parameters.

/media/uploads/dkato/hvcp2_demo_config_icon.jpg

Change transfer image size

By pressing USER_BUTTON0 on the back of the board, the image transfer size switches in the order of "160 x 120 -> 320 x 240 -> no image".
/media/uploads/dkato/gr-peach_switch2.jpg

HVC/STBLib/usr_include/STBTypedef.h@5:49a61433290a, 2017-09-05 (annotated)

Committer:: dkato
Date:: Tue Sep 05 10:01:51 2017 +0000
Revision:: 5:49a61433290a

Add HVC sensing result stabilizing library

Who changed what in which revision?

User	Revision	Line number	New contents of line
dkato	5:49a61433290a	1	/---------------------------------------------------------------------------/
dkato	5:49a61433290a	2	/* Copyright(C) 2017 OMRON Corporation */
dkato	5:49a61433290a	3	/* */
dkato	5:49a61433290a	4	/* Licensed under the Apache License, Version 2.0 (the "License"); */
dkato	5:49a61433290a	5	/* you may not use this file except in compliance with the License. */
dkato	5:49a61433290a	6	/* You may obtain a copy of the License at */
dkato	5:49a61433290a	7	/* */
dkato	5:49a61433290a	8	/* http://www.apache.org/licenses/LICENSE-2.0 */
dkato	5:49a61433290a	9	/* */
dkato	5:49a61433290a	10	/* Unless required by applicable law or agreed to in writing, software */
dkato	5:49a61433290a	11	/* distributed under the License is distributed on an "AS IS" BASIS, */
dkato	5:49a61433290a	12	/* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. */
dkato	5:49a61433290a	13	/* See the License for the specific language governing permissions and */
dkato	5:49a61433290a	14	/* limitations under the License. */
dkato	5:49a61433290a	15	/---------------------------------------------------------------------------/
dkato	5:49a61433290a	16
dkato	5:49a61433290a	17	#ifndef __STB_TYPEDEF_H__
dkato	5:49a61433290a	18	#define __STB_TYPEDEF_H__
dkato	5:49a61433290a	19
dkato	5:49a61433290a	20
dkato	5:49a61433290a	21	#ifndef VOID
dkato	5:49a61433290a	22	#define VOID void
dkato	5:49a61433290a	23	#endif /* VOID */
dkato	5:49a61433290a	24
dkato	5:49a61433290a	25	typedef signed char STB_INT8 ; /* 8-bit signed integer */
dkato	5:49a61433290a	26	typedef unsigned char STB_UINT8 ; /* 8-bit unsigned integer */
dkato	5:49a61433290a	27	typedef signed short STB_INT16 ; /* 16-bit signed integer */
dkato	5:49a61433290a	28	typedef unsigned short STB_UINT16 ; /* 16-bit unsigned integer */
dkato	5:49a61433290a	29	typedef int STB_INT32 ; /* 32 bit signed integer */
dkato	5:49a61433290a	30	typedef unsigned int STB_UINT32 ; /* 32 bit unsigned integer */
dkato	5:49a61433290a	31	typedef float STB_FLOAT32 ; /* 32-bit floating point number */
dkato	5:49a61433290a	32	typedef double STB_FLOAT64 ; /* 64-bit floating point number */
dkato	5:49a61433290a	33
dkato	5:49a61433290a	34
dkato	5:49a61433290a	35
dkato	5:49a61433290a	36	/****************************************/
dkato	5:49a61433290a	37	/* INPUT data strucrure to STBLib. */
dkato	5:49a61433290a	38	/****************************************/
dkato	5:49a61433290a	39
dkato	5:49a61433290a	40	typedef enum {
dkato	5:49a61433290a	41	STB_Expression_Neutral,
dkato	5:49a61433290a	42	STB_Expression_Happiness,
dkato	5:49a61433290a	43	STB_Expression_Surprise,
dkato	5:49a61433290a	44	STB_Expression_Anger,
dkato	5:49a61433290a	45	STB_Expression_Sadness,
dkato	5:49a61433290a	46	STB_Expression_Max
dkato	5:49a61433290a	47	} STB_OKAO_EXPRESSION;
dkato	5:49a61433290a	48
dkato	5:49a61433290a	49	typedef struct {
dkato	5:49a61433290a	50	STB_INT32 nX;
dkato	5:49a61433290a	51	STB_INT32 nY;
dkato	5:49a61433290a	52	} STB_POINT;
dkato	5:49a61433290a	53
dkato	5:49a61433290a	54	/* Face direction estimation */
dkato	5:49a61433290a	55	typedef struct {
dkato	5:49a61433290a	56	STB_INT32 nLR;
dkato	5:49a61433290a	57	STB_INT32 nUD;
dkato	5:49a61433290a	58	STB_INT32 nRoll;
dkato	5:49a61433290a	59	STB_INT32 nConfidence;
dkato	5:49a61433290a	60	} STB_FRAME_RESULT_DIRECTION;
dkato	5:49a61433290a	61
dkato	5:49a61433290a	62	/* Age estimation */
dkato	5:49a61433290a	63	typedef struct {
dkato	5:49a61433290a	64	STB_INT32 nAge;
dkato	5:49a61433290a	65	STB_INT32 nConfidence;
dkato	5:49a61433290a	66	} STB_FRAME_RESULT_AGE;
dkato	5:49a61433290a	67
dkato	5:49a61433290a	68	/* Gender estimation */
dkato	5:49a61433290a	69	typedef struct {
dkato	5:49a61433290a	70	STB_INT32 nGender;
dkato	5:49a61433290a	71	STB_INT32 nConfidence;
dkato	5:49a61433290a	72	} STB_FRAME_RESULT_GENDER;
dkato	5:49a61433290a	73
dkato	5:49a61433290a	74	/* Gaze estimation */
dkato	5:49a61433290a	75	typedef struct {
dkato	5:49a61433290a	76	STB_INT32 nLR;
dkato	5:49a61433290a	77	STB_INT32 nUD;
dkato	5:49a61433290a	78	} STB_FRAME_RESULT_GAZE;
dkato	5:49a61433290a	79
dkato	5:49a61433290a	80	/* Blink estimation */
dkato	5:49a61433290a	81	typedef struct {
dkato	5:49a61433290a	82	STB_INT32 nLeftEye;
dkato	5:49a61433290a	83	STB_INT32 nRightEye;
dkato	5:49a61433290a	84	} STB_FRAME_RESULT_BLINK;
dkato	5:49a61433290a	85
dkato	5:49a61433290a	86	/* Facial expression estimation */
dkato	5:49a61433290a	87	typedef struct {
dkato	5:49a61433290a	88	STB_INT32 anScore[STB_Expression_Max];
dkato	5:49a61433290a	89	STB_INT32 nDegree;
dkato	5:49a61433290a	90	} STB_FRAME_RESULT_EXPRESSION;
dkato	5:49a61433290a	91
dkato	5:49a61433290a	92	/* Face recognition */
dkato	5:49a61433290a	93	typedef struct {
dkato	5:49a61433290a	94	STB_INT32 nUID;
dkato	5:49a61433290a	95	STB_INT32 nScore;
dkato	5:49a61433290a	96	} STB_FRAME_RESULT_RECOGNITION;
dkato	5:49a61433290a	97
dkato	5:49a61433290a	98	/* One detection result */
dkato	5:49a61433290a	99	typedef struct {
dkato	5:49a61433290a	100	STB_POINT center;
dkato	5:49a61433290a	101	STB_INT32 nSize;
dkato	5:49a61433290a	102	STB_INT32 nConfidence ;
dkato	5:49a61433290a	103	} STB_FRAME_RESULT_DETECTION;
dkato	5:49a61433290a	104
dkato	5:49a61433290a	105	/* Face detection and post-processing result (1 person) */
dkato	5:49a61433290a	106	typedef struct {
dkato	5:49a61433290a	107	STB_POINT center;
dkato	5:49a61433290a	108	STB_INT32 nSize;
dkato	5:49a61433290a	109	STB_INT32 nConfidence;
dkato	5:49a61433290a	110	STB_FRAME_RESULT_DIRECTION direction;
dkato	5:49a61433290a	111	STB_FRAME_RESULT_AGE age;
dkato	5:49a61433290a	112	STB_FRAME_RESULT_GENDER gender;
dkato	5:49a61433290a	113	STB_FRAME_RESULT_GAZE gaze;
dkato	5:49a61433290a	114	STB_FRAME_RESULT_BLINK blink;
dkato	5:49a61433290a	115	STB_FRAME_RESULT_EXPRESSION expression;
dkato	5:49a61433290a	116	STB_FRAME_RESULT_RECOGNITION recognition;
dkato	5:49a61433290a	117	} STB_FRAME_RESULT_FACE;
dkato	5:49a61433290a	118
dkato	5:49a61433290a	119	/* One human body detection result */
dkato	5:49a61433290a	120	typedef struct {
dkato	5:49a61433290a	121	STB_INT32 nCount;
dkato	5:49a61433290a	122	STB_FRAME_RESULT_DETECTION body[35];
dkato	5:49a61433290a	123	} STB_FRAME_RESULT_BODYS;
dkato	5:49a61433290a	124
dkato	5:49a61433290a	125	/* Face detection and post-processing result (1 frame) */
dkato	5:49a61433290a	126	typedef struct {
dkato	5:49a61433290a	127	STB_INT32 nCount;
dkato	5:49a61433290a	128	STB_FRAME_RESULT_FACE face[35];
dkato	5:49a61433290a	129	} STB_FRAME_RESULT_FACES;
dkato	5:49a61433290a	130
dkato	5:49a61433290a	131	/* FRAME result (1 frame) */
dkato	5:49a61433290a	132	typedef struct {
dkato	5:49a61433290a	133	STB_FRAME_RESULT_BODYS bodys;
dkato	5:49a61433290a	134	STB_FRAME_RESULT_FACES faces;
dkato	5:49a61433290a	135	} STB_FRAME_RESULT;
dkato	5:49a61433290a	136
dkato	5:49a61433290a	137
dkato	5:49a61433290a	138	/****************************************/
dkato	5:49a61433290a	139	/* OUTPUT data strucrure from STBLib. */
dkato	5:49a61433290a	140	/****************************************/
dkato	5:49a61433290a	141
dkato	5:49a61433290a	142	#define STB_CONF_NO_DATA -1 /* No confidence (No data or in the case of stabilization time) */
dkato	5:49a61433290a	143
dkato	5:49a61433290a	144	typedef enum {
dkato	5:49a61433290a	145	STB_STATUS_NO_DATA = -1, /* No data : No data for the relevant person */
dkato	5:49a61433290a	146	STB_STATUS_CALCULATING = 0, /* During stabilization : a number of data for relevant people aren't enough(a number of frames that relevant people are taken) */
dkato	5:49a61433290a	147	STB_STATUS_COMPLETE = 1, /* Stabilization done : the frames which done stabilization */
dkato	5:49a61433290a	148	STB_STATUS_FIXED = 2, /* Stabilization fixed : already stabilization done, the results is fixed */
dkato	5:49a61433290a	149	} STB_STATUS; /* Status of stabilization */
dkato	5:49a61433290a	150
dkato	5:49a61433290a	151
dkato	5:49a61433290a	152	/* Expression */
dkato	5:49a61433290a	153	typedef enum {
dkato	5:49a61433290a	154	STB_EX_UNKNOWN = -1,
dkato	5:49a61433290a	155	STB_EX_NEUTRAL = 0,
dkato	5:49a61433290a	156	STB_EX_HAPPINESS,
dkato	5:49a61433290a	157	STB_EX_SURPRISE,
dkato	5:49a61433290a	158	STB_EX_ANGER,
dkato	5:49a61433290a	159	STB_EX_SADNESS,
dkato	5:49a61433290a	160	STB_EX_MAX
dkato	5:49a61433290a	161	}STB_EXPRESSION;
dkato	5:49a61433290a	162
dkato	5:49a61433290a	163	/* General purpose stabilization result structure */
dkato	5:49a61433290a	164	typedef struct {
dkato	5:49a61433290a	165	STB_STATUS status; /* Stabilization status */
dkato	5:49a61433290a	166	STB_INT32 conf; /* Stabilization confidence */
dkato	5:49a61433290a	167	STB_INT32 value;
dkato	5:49a61433290a	168	} STB_RES;
dkato	5:49a61433290a	169
dkato	5:49a61433290a	170	/* Result of Gaze estimation */
dkato	5:49a61433290a	171	typedef struct {
dkato	5:49a61433290a	172	STB_STATUS status; /* Stabilization status */
dkato	5:49a61433290a	173	STB_INT32 conf; /* Stabilization confidence */
dkato	5:49a61433290a	174	STB_INT32 UD;
dkato	5:49a61433290a	175	STB_INT32 LR;
dkato	5:49a61433290a	176	} STB_GAZE;
dkato	5:49a61433290a	177
dkato	5:49a61433290a	178	/* Result of Face direction estimation */
dkato	5:49a61433290a	179	typedef struct {
dkato	5:49a61433290a	180	STB_STATUS status; /* Stabilization status */
dkato	5:49a61433290a	181	STB_INT32 conf; /* Stabilization confidence */
dkato	5:49a61433290a	182	STB_INT32 yaw;
dkato	5:49a61433290a	183	STB_INT32 pitch;
dkato	5:49a61433290a	184	STB_INT32 roll;
dkato	5:49a61433290a	185	} STB_DIR;
dkato	5:49a61433290a	186
dkato	5:49a61433290a	187	/* Result of Blink estimation */
dkato	5:49a61433290a	188	typedef struct {
dkato	5:49a61433290a	189	STB_STATUS status; /* Stabilization status */
dkato	5:49a61433290a	190	STB_INT32 ratioL;
dkato	5:49a61433290a	191	STB_INT32 ratioR;
dkato	5:49a61433290a	192	} STB_BLINK;
dkato	5:49a61433290a	193
dkato	5:49a61433290a	194	/* Detection position structure */
dkato	5:49a61433290a	195	typedef struct {
dkato	5:49a61433290a	196	STB_UINT32 x;
dkato	5:49a61433290a	197	STB_UINT32 y;
dkato	5:49a61433290a	198	} STB_POS;
dkato	5:49a61433290a	199
dkato	5:49a61433290a	200	/* Face stabilization result structure */
dkato	5:49a61433290a	201	typedef struct {
dkato	5:49a61433290a	202	STB_INT32 nDetectID;
dkato	5:49a61433290a	203	STB_INT32 nTrackingID;
dkato	5:49a61433290a	204	STB_POS center;
dkato	5:49a61433290a	205	STB_UINT32 nSize;
dkato	5:49a61433290a	206	STB_INT32 conf;
dkato	5:49a61433290a	207	STB_DIR direction;
dkato	5:49a61433290a	208	STB_RES age;
dkato	5:49a61433290a	209	STB_RES gender;
dkato	5:49a61433290a	210	STB_GAZE gaze;
dkato	5:49a61433290a	211	STB_BLINK blink;
dkato	5:49a61433290a	212	STB_RES expression;
dkato	5:49a61433290a	213	STB_RES recognition;
dkato	5:49a61433290a	214	} STB_FACE;
dkato	5:49a61433290a	215
dkato	5:49a61433290a	216	/* Human body stabilization result structure */
dkato	5:49a61433290a	217	typedef struct {
dkato	5:49a61433290a	218	STB_INT32 nDetectID;
dkato	5:49a61433290a	219	STB_INT32 nTrackingID;
dkato	5:49a61433290a	220	STB_POS center;
dkato	5:49a61433290a	221	STB_UINT32 nSize;
dkato	5:49a61433290a	222	STB_INT32 conf;
dkato	5:49a61433290a	223	} STB_BODY;
dkato	5:49a61433290a	224
dkato	5:49a61433290a	225
dkato	5:49a61433290a	226	#endif /* __STB_TYPEDEF_H__ */
dkato	5:49a61433290a	227

Repository toolbox

Export to desktop IDE

Build repository

Repository details

Type:	Program
Mbed OS support:	Mbed OS
Created:	23 Jan 2017
Imports:	115
Forks:	0
Commits:	9
Dependents:	0
Dependencies:	1
Followers:	59