A simple musical instrument application using pressure and distance measuring sensors

Dependencies:   MjGP2Y0E03 mbed

Information

日本語版がこのページ下半分にあります!

Japanese version is available lower half of this page.

What is this?

Watch this video.

A very simple musical instrument application using pressure and distance measuring sensors.

Hardware

The uchiwa tone has very simple hardware.

  • Microcontroller module : mbed LPC1768
  • Pressure sensor : Interlink Electronics FSR400
  • Distance measuring sensor : Sharp GP2Y0E03

The two sensor output goes into mbed, the pressure sensor controls the sound amplitude and distance controls frequency.
Sound waveform is stored on RAM in mbed. This waveform is played with those sensor parameters.
Output comes from DAC output of mbed, so the output becomes sound through external amplifier and speaker.

IMPORTANT

The distance measuring sensor GP2Y0E03 uses infra-red light reflection from objects.
In my case, for the reflecting object, I used "uchiwa (a Japanese fan)" is used.

Don't be so pessimistic, if you don't have the uchiwa.
It may be OK to use enough size of cardboard or something ;)

uchiwa_dog

hardware

Software

Some customization can be done in software.

Key/Pitch

The key of this instrument is made as "C".
When you get the (reflecting object's) distance of the "C", all 3 LED1, LED2 and LED3 will be turned-ON. This is a mechanism to help the player who does not have perfect pitch like me ;)
This reference tone (key) can be changed by REFERENCE_TONE which is set as an item from "Tone_list".

Pitch can be controlled also. Edit the frequency for "A" by REFERENCE_PITCH.

enum Tone_list {
    Tone_A      = 0,
    Tone_Ais,
    Tone_H,
    Tone_C,
    Tone_Cis,
    Tone_D,
    Tone_Dis,
    Tone_E,
    Tone_Eis,
    Tone_F,
    Tone_G,
    Tone_Gis,
};

#define     REFERENCE_TONE  ((float)Tone_C)
#define     REFERENCE_PITCH 442.0

Frequency control direction

The distance measuring sensor output controls the frequency.
Default setting is it generates lower frequency when the distance is shorter.
If you need opposite direction of frequency control, set CONTROL_DIRECTION as SHORT_HIGH.

#define     SHORT_HIGH  0
#define     SHORT_LOW   1
#define     CONTROL_DIRECTION   SHORT_LOW

Waveform

The uchiwa tone plays sound which is stored in RAM.
This waveform can be changed by selecting options.

The program calculates the waveform before start the instrument operation. The calculation is done in function of init() calling waveform_generator().

Sin wave

The default setting is WAVEFORM_SIN. That calculate sin wave.
By the way, if user press the pressure sensor strong, the amplitude becomes over 100%. The uchiwa tone handles this high amplitude situation as clipping, which becomes distortion.

Other waveform

WAVEFORM_SAWTOOTH and WAVEFORM_CUSTOM_HARMONICS options are available also. The WAVEFORM_SAWTOOTH may give different sound taste.

float waveform_generator( int i )
{
#define WAVEFORM_SIN
//#define WAVEFORM_SAWTOOTH
//#define WAVEFORM_CUSTOM_HARMONICS

WAVEFORM_CUSTOM_HARMONICS

The WAVEFORM_CUSTOM_HARMONICS gives you more options. The waveform is calculated with given parameters.
The waveform can be defined by each harmonics' (normalized) frequency, amplitude and phase.

The number of harmonics is arbitrary but if many harmonics are defined, it will take time.

#ifdef  WAVEFORM_CUSTOM_HARMONICS

    typedef struct  element_st {
        float   frequency;
        float   amplitude;
        float   phase;
    }
    element;

#define REF_AMPLITUDE   1.0
    static element e[] = {
        { 1.0,      REF_AMPLITUDE / 1.0,    0 * PI },
        { 3.0,      REF_AMPLITUDE / 3.0,    0 * PI },
        { 5.0,      REF_AMPLITUDE / 5.0,    0 * PI },
        { 3.33333,  REF_AMPLITUDE / 2.0,    0 * PI },//  nonintegral harmonics
    };

    float   f;
    r   = 0.0;

    for ( int x = 0; x < sizeof( e ) / sizeof( element ); x++ ) {
        f   = e[ x ].frequency * 2.0 * PI * ((float)i / (float)N_SAMPLES);
        r  += e[ x ].amplitude * cos( e[ x ].phase ) * sin( f );
        r  += e[ x ].amplitude * sin( e[ x ].phase ) * cos( f );
    }
#endif

Fully custom waveform

Of course you can make the waveform anything you want.
Fill up sample[16384] array with one cycle of your waveform.

Tips

Playing in right frequency

In default setting, when the distance measuring sensor gets distance for reference tone, all 3 LED1, LED2 and LED3 will be turned-ON.

There is an option to indicate the distance in heptatonic scale intervals. If the code compiled with #define OPERATION_AID, the LED, LED2 and LED3 will show the frequency is in those range (eighth note accuracy).

degreesol-faLED1LED2LED3
IdoONoffoff
IIreoffONoff
IIImiONONoff
IVfaoffoffON
VsolONoffON
VIlaoffONON
VIIsiONONON

Remark








これはなに?

このビデオを御覧ください.

圧力,測距センサを使った非常に単純な楽器アプリケーションです.

ハードウェア

「うちわトーン」のハードウェアはとても単純です.

2つのセンサの出力をmbedに接続.圧力センサが振幅を,距離が周波数を制御します.
音声波形はmbed内のRAMに保存されます.この音声波形がセンサからのパラメータに従って再生されます.
mbedのDAC出力を外部のアンプとスピーカと通すことによって音にします.

重要

測距センサ:GP2Y0E03は対象物からの赤外線の反射を用います.
私の場合,「うちわ」をその反射させるモノとして使いました.

でもうちわが用意できなくても凹む必要はありません
厚紙などでその代用が可能です.
uchiwa_dog

hardware

ソフトウェア

ソフトウェアによるカスタマイズが可能です.

キー/ピッチ

この楽器のキーは"C"にしてあります.
反射物(うちわ)を,その"C"の位置に持ってくると3個のLED,LED1,LED2,LED3が全て点灯します.これは私のような絶対音感の無い演奏者のために用意された仕組みです (^ ^;
この基準音(キー)はREFERENCE_TONEを「Tone_list」内の別のアイテムに設定することで変更可能です.

ピッチも変更可能です.基準音Aの周波数をREFERENCE_PITCHの値によって変更できます.

enum Tone_list {
    Tone_A      = 0,
    Tone_Ais,
    Tone_H,
    Tone_C,
    Tone_Cis,
    Tone_D,
    Tone_Dis,
    Tone_E,
    Tone_Eis,
    Tone_F,
    Tone_G,
    Tone_Gis,
};

#define     REFERENCE_TONE  ((float)Tone_C)
#define     REFERENCE_PITCH 442.0

周波数制御の方向

測距センサの出力で周波数が変わります.
デフォルト設定では測定された距離が近いほど低い音となります.
これを逆に設定するにはCONTROL_DIRECTIONをSHORT_HIGHに設定してください.

#define     SHORT_HIGH  0
#define     SHORT_LOW   1
#define     CONTROL_DIRECTION   SHORT_LOW

波形

うちわトーンではRAMに保存された音声を再生します.
波形はプション選択で変更可能です.

プログラムは楽器としての動作前に波形を計算します.計算はinit()関数から呼び出されるwaveform_generator()で行われます.

サイン波

WAVEFORM_SINがデフォルト設定となっています.サイン波を計算します.
ところで圧力センサを強く押すと振幅は100%を超えるようになっています.この場合,うちわトーンはクリッピング波形による歪んだ音を出力します.

その他の波形

その他WAVEFORM_SAWTOOTHWAVEFORM_CUSTOM_HARMONICSが用意されています. WAVEFORM_SAWTOOTHを選択すると違う音色が楽しめます.

float waveform_generator( int i )
{
#define WAVEFORM_SIN
//#define WAVEFORM_SAWTOOTH
//#define WAVEFORM_CUSTOM_HARMONICS

WAVEFORM_CUSTOM_HARMONICS (高調波カスタマイズ)

WAVEFORM_CUSTOM_HARMONICSによって更にカスタマイズ可能です.波形は設定したパラメータを元に計算します.
この波形は高調波毎の(正規化した)周波数,振幅,位相で定義されます.

高調波の数は任意ですが,たくさん定義すると計算に時間がかかります.

#ifdef  WAVEFORM_CUSTOM_HARMONICS

    typedef struct  element_st {
        float   frequency;
        float   amplitude;
        float   phase;
    }
    element;

#define REF_AMPLITUDE   1.0
    static element e[] = {
        { 1.0,      REF_AMPLITUDE / 1.0,    0 * PI },
        { 3.0,      REF_AMPLITUDE / 3.0,    0 * PI },
        { 5.0,      REF_AMPLITUDE / 5.0,    0 * PI },
        { 3.33333,  REF_AMPLITUDE / 2.0,    0 * PI },//  nonintegral harmonics
    };

    float   f;
    r   = 0.0;

    for ( int x = 0; x < sizeof( e ) / sizeof( element ); x++ ) {
        f   = e[ x ].frequency * 2.0 * PI * ((float)i / (float)N_SAMPLES);
        r  += e[ x ].amplitude * cos( e[ x ].phase ) * sin( f );
        r  += e[ x ].amplitude * sin( e[ x ].phase ) * cos( f );
    }
#endif

完全カスタム波形

もちろん波形は自由に作成したものを使うこともできます.
配列sample[16384]に一周期分の波形を保存ししてください.

ちょっとしたコツ

正確な周波数で演奏する

デフォルトの設定では,測距センサーの測定値が基準音を出すものになった時にLED1〜LED3が全て点灯するようになっています.

この他に7音階の距離を表示するオプションが用意されています. #define OPERATION_AIDを有効にしてコンパイルすると,周波数がそれぞれの範囲に入った時に,LED1〜LED3がそれを表示してくれます (1/8音精度).

degreesol-faLED1LED2LED3
IdoONoffoff
IIreoffONoff
IIImiONONoff
IVfaoffoffON
VsolONoffON
VIlaoffONON
VIIsiONONON

備考

Committer:
okano
Date:
Tue Jun 09 08:39:20 2015 +0000
Revision:
8:5af7a442e39a
Parent:
7:9522d9848470
Child:
9:fb5f6209a33b
waveform synthesising option added

Who changed what in which revision?

UserRevisionLine numberNew contents of line
okano 0:cc77dd0427d8 1 #include "mbed.h"
okano 7:9522d9848470 2 #include "MjGP2Y0E03.h"
okano 0:cc77dd0427d8 3
okano 1:86ac6f8d9713 4 DigitalOut led( LED1 );
okano 4:c06860b7a4ea 5 DigitalOut vitalsign( LED4 );
okano 0:cc77dd0427d8 6 AnalogIn key0( p19 );
okano 0:cc77dd0427d8 7 AnalogOut ao( p18 );
okano 0:cc77dd0427d8 8
okano 7:9522d9848470 9 I2C i2c( p28, p27 );
okano 7:9522d9848470 10 MjGP2Y0E03 distanceSensor(&i2c, 0x80);
okano 0:cc77dd0427d8 11
okano 0:cc77dd0427d8 12 #define PI 3.14159265
okano 1:86ac6f8d9713 13 #define K 3.0
okano 7:9522d9848470 14 #define K2 12.0
okano 0:cc77dd0427d8 15
okano 7:9522d9848470 16 #define SQUELCH 0.0
okano 6:0121755ba84b 17
okano 6:0121755ba84b 18 #define N_SAMPLES 16384
okano 6:0121755ba84b 19 short *sample = (short *)0x2007c000;
okano 6:0121755ba84b 20
okano 6:0121755ba84b 21 Ticker in;
okano 1:86ac6f8d9713 22 Ticker out;
okano 6:0121755ba84b 23 int in_flag = 0;
okano 6:0121755ba84b 24 int out_flag = 0;
okano 1:86ac6f8d9713 25 float amp;
okano 6:0121755ba84b 26 unsigned int count = 0;
okano 1:86ac6f8d9713 27 float ci = 1.0;
okano 7:9522d9848470 28 float ref_tone;
okano 2:225f68a31496 29
okano 3:b72b559aaee0 30 #define SHORT_HIGH 0
okano 3:b72b559aaee0 31 #define SHORT_LOW 1
okano 3:b72b559aaee0 32 #define CONTROL_DIRECTION SHORT_LOW
okano 3:b72b559aaee0 33
okano 2:225f68a31496 34 enum Tone_list {
okano 2:225f68a31496 35 Tone_A = 0,
okano 2:225f68a31496 36 Tone_Ais,
okano 4:c06860b7a4ea 37 Tone_H,
okano 2:225f68a31496 38 Tone_C,
okano 2:225f68a31496 39 Tone_Cis,
okano 2:225f68a31496 40 Tone_D,
okano 2:225f68a31496 41 Tone_Dis,
okano 2:225f68a31496 42 Tone_E,
okano 2:225f68a31496 43 Tone_Eis,
okano 2:225f68a31496 44 Tone_F,
okano 2:225f68a31496 45 Tone_G,
okano 2:225f68a31496 46 Tone_Gis,
okano 2:225f68a31496 47 };
okano 2:225f68a31496 48
okano 7:9522d9848470 49 #define REFERENCE_TONE ((float)Tone_C)
okano 7:9522d9848470 50 #define REFERENCE_PITCH 442.0
okano 7:9522d9848470 51
okano 2:225f68a31496 52 void init( void );
okano 6:0121755ba84b 53 void set_in_flag();
okano 6:0121755ba84b 54 void set_out_flag();
okano 2:225f68a31496 55
okano 3:b72b559aaee0 56 int main()
okano 3:b72b559aaee0 57 {
okano 2:225f68a31496 58 float ai;
okano 5:bb232622e1fc 59 int vc = 0;
okano 6:0121755ba84b 60
okano 2:225f68a31496 61 init();
okano 3:b72b559aaee0 62
okano 2:225f68a31496 63 while(1) {
okano 6:0121755ba84b 64 if ( in_flag ) {
okano 6:0121755ba84b 65 in_flag = 0;
okano 8:5af7a442e39a 66
okano 7:9522d9848470 67 amp = (key0 < SQUELCH) ? 0.0 : key0 * 2.0;
okano 8:5af7a442e39a 68
okano 6:0121755ba84b 69 ai = distanceSensor.rd();
okano 3:b72b559aaee0 70
okano 3:b72b559aaee0 71 #if (CONTROL_DIRECTION == SHORT_HIGH)
okano 6:0121755ba84b 72 ci = (2.25 - ai * 1.5);
okano 3:b72b559aaee0 73 #else
okano 6:0121755ba84b 74 ci = (0.75 + ai * 1.5);
okano 3:b72b559aaee0 75 #endif
okano 3:b72b559aaee0 76
okano 6:0121755ba84b 77 if ( (0.95 < ci) && (ci < 1.05) )
okano 6:0121755ba84b 78 led = 1;
okano 6:0121755ba84b 79 else
okano 6:0121755ba84b 80 led = 0;
okano 3:b72b559aaee0 81
okano 6:0121755ba84b 82 vitalsign = (vc++ >> 4) & 0x1;
okano 6:0121755ba84b 83 }
okano 2:225f68a31496 84 }
okano 2:225f68a31496 85 }
okano 0:cc77dd0427d8 86
okano 8:5af7a442e39a 87
okano 8:5af7a442e39a 88
okano 8:5af7a442e39a 89 float waveform_generator( int i )
okano 8:5af7a442e39a 90 {
okano 8:5af7a442e39a 91 //#define WAVEFORM_SIN
okano 8:5af7a442e39a 92 //#define WAVEFORM_SAWTOOTH
okano 8:5af7a442e39a 93 #define WAVEFORM_CUSTOM_HARMONICS
okano 8:5af7a442e39a 94
okano 8:5af7a442e39a 95 float r;
okano 8:5af7a442e39a 96
okano 8:5af7a442e39a 97 #ifdef WAVEFORM_SAWTOOTH
okano 8:5af7a442e39a 98 r = (float)i / (float)N_SAMPLES;
okano 8:5af7a442e39a 99 #endif
okano 8:5af7a442e39a 100
okano 8:5af7a442e39a 101 #ifdef WAVEFORM_SIN
okano 8:5af7a442e39a 102 r = sin( 2.0 * PI * ((float)i / (float)N_SAMPLES) );
okano 8:5af7a442e39a 103 #endif
okano 8:5af7a442e39a 104
okano 8:5af7a442e39a 105 #ifdef WAVEFORM_CUSTOM_HARMONICS
okano 8:5af7a442e39a 106
okano 8:5af7a442e39a 107 typedef struct element_st {
okano 8:5af7a442e39a 108 float frequency;
okano 8:5af7a442e39a 109 float amplitude;
okano 8:5af7a442e39a 110 float phase;
okano 8:5af7a442e39a 111 }
okano 8:5af7a442e39a 112 element;
okano 8:5af7a442e39a 113
okano 8:5af7a442e39a 114 #define REF_AMPLITUDE 1.0
okano 8:5af7a442e39a 115 element e[] = {
okano 8:5af7a442e39a 116 { 1.0, REF_AMPLITUDE / 1.0, 0 * PI },
okano 8:5af7a442e39a 117 // { 2.0, REF_AMPLITUDE / 2.0, 0 * PI },
okano 8:5af7a442e39a 118 { 3.0, REF_AMPLITUDE / 3.0, 0 * PI },
okano 8:5af7a442e39a 119 // { 4.0, REF_AMPLITUDE / 4.0, 0 * PI },
okano 8:5af7a442e39a 120 { 5.0, REF_AMPLITUDE / 5.0, 0 * PI },
okano 8:5af7a442e39a 121 // { 6.0, REF_AMPLITUDE / 4.0, 0 * PI },
okano 8:5af7a442e39a 122 { 7.0, REF_AMPLITUDE / 7.0, 0 * PI },
okano 8:5af7a442e39a 123 // { 3.33333, REF_AMPLITUDE / 2.0, 0 * PI },// nonintegral harmonics
okano 8:5af7a442e39a 124 // { 11.9311, REF_AMPLITUDE / 2.0, 0 * PI },// nonintegral harmonics
okano 8:5af7a442e39a 125 };
okano 8:5af7a442e39a 126
okano 8:5af7a442e39a 127 float f;
okano 8:5af7a442e39a 128 r = 0.0;
okano 8:5af7a442e39a 129
okano 8:5af7a442e39a 130 for ( int x = 0; x < sizeof( e ) / sizeof( element ); x++ ) {
okano 8:5af7a442e39a 131 f = e[ x ].frequency * 2.0 * PI * ((float)i / (float)N_SAMPLES);
okano 8:5af7a442e39a 132 r += e[ x ].amplitude * cos( e[ x ].phase ) * sin( f );
okano 8:5af7a442e39a 133 r += e[ x ].amplitude * sin( e[ x ].phase ) * cos( f );
okano 8:5af7a442e39a 134 }
okano 8:5af7a442e39a 135 #endif
okano 8:5af7a442e39a 136 return ( r );
okano 8:5af7a442e39a 137 }
okano 8:5af7a442e39a 138
okano 0:cc77dd0427d8 139 void init( void )
okano 0:cc77dd0427d8 140 {
okano 3:b72b559aaee0 141 for ( int i = 0; i < N_SAMPLES; i++ ) {
okano 8:5af7a442e39a 142 sample[ i ] = (short)(32767.0 * waveform_generator( i ));
okano 0:cc77dd0427d8 143 }
okano 2:225f68a31496 144
okano 7:9522d9848470 145 ref_tone = (REFERENCE_PITCH * pow( 2.0, REFERENCE_TONE / 12.0 )) /K2 * K;
okano 8:5af7a442e39a 146
okano 6:0121755ba84b 147 i2c.frequency( 400 * 1000 );
okano 3:b72b559aaee0 148
okano 7:9522d9848470 149 printf( "output sampling freq = %f kHz\r\n", ((float)(N_SAMPLES / K) * K2) / 1000.0 );
okano 7:9522d9848470 150
okano 6:0121755ba84b 151 in.attach( &set_in_flag, 1.0 / 100.0 );
okano 6:0121755ba84b 152 out.attach( &set_out_flag, 1.0 / ((float)(N_SAMPLES / K) * K2) );
okano 0:cc77dd0427d8 153 }
okano 0:cc77dd0427d8 154
okano 6:0121755ba84b 155 void set_in_flag()
okano 6:0121755ba84b 156 {
okano 6:0121755ba84b 157 in_flag = 1;
okano 6:0121755ba84b 158 }
okano 6:0121755ba84b 159
okano 6:0121755ba84b 160 void set_out_flag()
okano 6:0121755ba84b 161 {
okano 6:0121755ba84b 162 ao = 0.5 + (amp * ((float)sample[ count & 0x3FFF ] / 65536.0));
okano 7:9522d9848470 163 count += (int)(ref_tone * ci);
okano 6:0121755ba84b 164 out_flag = 1;
okano 0:cc77dd0427d8 165 }