A simple musical instrument application using pressure and distance measuring sensors

Dependencies:   MjGP2Y0E03 mbed

Information

日本語版がこのページ下半分にあります!

Japanese version is available lower half of this page.

What is this?

Watch this video.

A very simple musical instrument application using pressure and distance measuring sensors.

Hardware

The uchiwa tone has very simple hardware.

  • Microcontroller module : mbed LPC1768
  • Pressure sensor : Interlink Electronics FSR400
  • Distance measuring sensor : Sharp GP2Y0E03

The two sensor output goes into mbed, the pressure sensor controls the sound amplitude and distance controls frequency.
Sound waveform is stored on RAM in mbed. This waveform is played with those sensor parameters.
Output comes from DAC output of mbed, so the output becomes sound through external amplifier and speaker.

IMPORTANT

The distance measuring sensor GP2Y0E03 uses infra-red light reflection from objects.
In my case, for the reflecting object, I used "uchiwa (a Japanese fan)" is used.

Don't be so pessimistic, if you don't have the uchiwa.
It may be OK to use enough size of cardboard or something ;)

uchiwa_dog

hardware

Software

Some customization can be done in software.

Key/Pitch

The key of this instrument is made as "C".
When you get the (reflecting object's) distance of the "C", all 3 LED1, LED2 and LED3 will be turned-ON. This is a mechanism to help the player who does not have perfect pitch like me ;)
This reference tone (key) can be changed by REFERENCE_TONE which is set as an item from "Tone_list".

Pitch can be controlled also. Edit the frequency for "A" by REFERENCE_PITCH.

enum Tone_list {
    Tone_A      = 0,
    Tone_Ais,
    Tone_H,
    Tone_C,
    Tone_Cis,
    Tone_D,
    Tone_Dis,
    Tone_E,
    Tone_Eis,
    Tone_F,
    Tone_G,
    Tone_Gis,
};

#define     REFERENCE_TONE  ((float)Tone_C)
#define     REFERENCE_PITCH 442.0

Frequency control direction

The distance measuring sensor output controls the frequency.
Default setting is it generates lower frequency when the distance is shorter.
If you need opposite direction of frequency control, set CONTROL_DIRECTION as SHORT_HIGH.

#define     SHORT_HIGH  0
#define     SHORT_LOW   1
#define     CONTROL_DIRECTION   SHORT_LOW

Waveform

The uchiwa tone plays sound which is stored in RAM.
This waveform can be changed by selecting options.

The program calculates the waveform before start the instrument operation. The calculation is done in function of init() calling waveform_generator().

Sin wave

The default setting is WAVEFORM_SIN. That calculate sin wave.
By the way, if user press the pressure sensor strong, the amplitude becomes over 100%. The uchiwa tone handles this high amplitude situation as clipping, which becomes distortion.

Other waveform

WAVEFORM_SAWTOOTH and WAVEFORM_CUSTOM_HARMONICS options are available also. The WAVEFORM_SAWTOOTH may give different sound taste.

float waveform_generator( int i )
{
#define WAVEFORM_SIN
//#define WAVEFORM_SAWTOOTH
//#define WAVEFORM_CUSTOM_HARMONICS

WAVEFORM_CUSTOM_HARMONICS

The WAVEFORM_CUSTOM_HARMONICS gives you more options. The waveform is calculated with given parameters.
The waveform can be defined by each harmonics' (normalized) frequency, amplitude and phase.

The number of harmonics is arbitrary but if many harmonics are defined, it will take time.

#ifdef  WAVEFORM_CUSTOM_HARMONICS

    typedef struct  element_st {
        float   frequency;
        float   amplitude;
        float   phase;
    }
    element;

#define REF_AMPLITUDE   1.0
    static element e[] = {
        { 1.0,      REF_AMPLITUDE / 1.0,    0 * PI },
        { 3.0,      REF_AMPLITUDE / 3.0,    0 * PI },
        { 5.0,      REF_AMPLITUDE / 5.0,    0 * PI },
        { 3.33333,  REF_AMPLITUDE / 2.0,    0 * PI },//  nonintegral harmonics
    };

    float   f;
    r   = 0.0;

    for ( int x = 0; x < sizeof( e ) / sizeof( element ); x++ ) {
        f   = e[ x ].frequency * 2.0 * PI * ((float)i / (float)N_SAMPLES);
        r  += e[ x ].amplitude * cos( e[ x ].phase ) * sin( f );
        r  += e[ x ].amplitude * sin( e[ x ].phase ) * cos( f );
    }
#endif

Fully custom waveform

Of course you can make the waveform anything you want.
Fill up sample[16384] array with one cycle of your waveform.

Tips

Playing in right frequency

In default setting, when the distance measuring sensor gets distance for reference tone, all 3 LED1, LED2 and LED3 will be turned-ON.

There is an option to indicate the distance in heptatonic scale intervals. If the code compiled with #define OPERATION_AID, the LED, LED2 and LED3 will show the frequency is in those range (eighth note accuracy).

degreesol-faLED1LED2LED3
IdoONoffoff
IIreoffONoff
IIImiONONoff
IVfaoffoffON
VsolONoffON
VIlaoffONON
VIIsiONONON

Remark








これはなに?

このビデオを御覧ください.

圧力,測距センサを使った非常に単純な楽器アプリケーションです.

ハードウェア

「うちわトーン」のハードウェアはとても単純です.

2つのセンサの出力をmbedに接続.圧力センサが振幅を,距離が周波数を制御します.
音声波形はmbed内のRAMに保存されます.この音声波形がセンサからのパラメータに従って再生されます.
mbedのDAC出力を外部のアンプとスピーカと通すことによって音にします.

重要

測距センサ:GP2Y0E03は対象物からの赤外線の反射を用います.
私の場合,「うちわ」をその反射させるモノとして使いました.

でもうちわが用意できなくても凹む必要はありません
厚紙などでその代用が可能です.
uchiwa_dog

hardware

ソフトウェア

ソフトウェアによるカスタマイズが可能です.

キー/ピッチ

この楽器のキーは"C"にしてあります.
反射物(うちわ)を,その"C"の位置に持ってくると3個のLED,LED1,LED2,LED3が全て点灯します.これは私のような絶対音感の無い演奏者のために用意された仕組みです (^ ^;
この基準音(キー)はREFERENCE_TONEを「Tone_list」内の別のアイテムに設定することで変更可能です.

ピッチも変更可能です.基準音Aの周波数をREFERENCE_PITCHの値によって変更できます.

enum Tone_list {
    Tone_A      = 0,
    Tone_Ais,
    Tone_H,
    Tone_C,
    Tone_Cis,
    Tone_D,
    Tone_Dis,
    Tone_E,
    Tone_Eis,
    Tone_F,
    Tone_G,
    Tone_Gis,
};

#define     REFERENCE_TONE  ((float)Tone_C)
#define     REFERENCE_PITCH 442.0

周波数制御の方向

測距センサの出力で周波数が変わります.
デフォルト設定では測定された距離が近いほど低い音となります.
これを逆に設定するにはCONTROL_DIRECTIONをSHORT_HIGHに設定してください.

#define     SHORT_HIGH  0
#define     SHORT_LOW   1
#define     CONTROL_DIRECTION   SHORT_LOW

波形

うちわトーンではRAMに保存された音声を再生します.
波形はプション選択で変更可能です.

プログラムは楽器としての動作前に波形を計算します.計算はinit()関数から呼び出されるwaveform_generator()で行われます.

サイン波

WAVEFORM_SINがデフォルト設定となっています.サイン波を計算します.
ところで圧力センサを強く押すと振幅は100%を超えるようになっています.この場合,うちわトーンはクリッピング波形による歪んだ音を出力します.

その他の波形

その他WAVEFORM_SAWTOOTHWAVEFORM_CUSTOM_HARMONICSが用意されています. WAVEFORM_SAWTOOTHを選択すると違う音色が楽しめます.

float waveform_generator( int i )
{
#define WAVEFORM_SIN
//#define WAVEFORM_SAWTOOTH
//#define WAVEFORM_CUSTOM_HARMONICS

WAVEFORM_CUSTOM_HARMONICS (高調波カスタマイズ)

WAVEFORM_CUSTOM_HARMONICSによって更にカスタマイズ可能です.波形は設定したパラメータを元に計算します.
この波形は高調波毎の(正規化した)周波数,振幅,位相で定義されます.

高調波の数は任意ですが,たくさん定義すると計算に時間がかかります.

#ifdef  WAVEFORM_CUSTOM_HARMONICS

    typedef struct  element_st {
        float   frequency;
        float   amplitude;
        float   phase;
    }
    element;

#define REF_AMPLITUDE   1.0
    static element e[] = {
        { 1.0,      REF_AMPLITUDE / 1.0,    0 * PI },
        { 3.0,      REF_AMPLITUDE / 3.0,    0 * PI },
        { 5.0,      REF_AMPLITUDE / 5.0,    0 * PI },
        { 3.33333,  REF_AMPLITUDE / 2.0,    0 * PI },//  nonintegral harmonics
    };

    float   f;
    r   = 0.0;

    for ( int x = 0; x < sizeof( e ) / sizeof( element ); x++ ) {
        f   = e[ x ].frequency * 2.0 * PI * ((float)i / (float)N_SAMPLES);
        r  += e[ x ].amplitude * cos( e[ x ].phase ) * sin( f );
        r  += e[ x ].amplitude * sin( e[ x ].phase ) * cos( f );
    }
#endif

完全カスタム波形

もちろん波形は自由に作成したものを使うこともできます.
配列sample[16384]に一周期分の波形を保存ししてください.

ちょっとしたコツ

正確な周波数で演奏する

デフォルトの設定では,測距センサーの測定値が基準音を出すものになった時にLED1〜LED3が全て点灯するようになっています.

この他に7音階の距離を表示するオプションが用意されています. #define OPERATION_AIDを有効にしてコンパイルすると,周波数がそれぞれの範囲に入った時に,LED1〜LED3がそれを表示してくれます (1/8音精度).

degreesol-faLED1LED2LED3
IdoONoffoff
IIreoffONoff
IIImiONONoff
IVfaoffoffON
VsolONoffON
VIlaoffONON
VIIsiONONON

備考

Committer:
okano
Date:
Sat Jun 13 03:43:12 2015 +0000
Revision:
11:a591cfa45d4e
Parent:
9:fb5f6209a33b
Child:
13:d20f32f4d9a0
release 1 (^^)

Who changed what in which revision?

UserRevisionLine numberNew contents of line
okano 0:cc77dd0427d8 1 #include "mbed.h"
okano 7:9522d9848470 2 #include "MjGP2Y0E03.h"
okano 0:cc77dd0427d8 3
okano 9:fb5f6209a33b 4 BusOut leds( LED1, LED2, LED3 );
okano 4:c06860b7a4ea 5 DigitalOut vitalsign( LED4 );
okano 0:cc77dd0427d8 6 AnalogIn key0( p19 );
okano 0:cc77dd0427d8 7 AnalogOut ao( p18 );
okano 0:cc77dd0427d8 8
okano 7:9522d9848470 9 I2C i2c( p28, p27 );
okano 7:9522d9848470 10 MjGP2Y0E03 distanceSensor(&i2c, 0x80);
okano 0:cc77dd0427d8 11
okano 9:fb5f6209a33b 12 #define PI 3.1415926535897932384626433
okano 1:86ac6f8d9713 13 #define K 3.0
okano 7:9522d9848470 14 #define K2 12.0
okano 0:cc77dd0427d8 15
okano 7:9522d9848470 16 #define SQUELCH 0.0
okano 6:0121755ba84b 17
okano 6:0121755ba84b 18 #define N_SAMPLES 16384
okano 6:0121755ba84b 19 short *sample = (short *)0x2007c000;
okano 6:0121755ba84b 20
okano 6:0121755ba84b 21 Ticker in;
okano 1:86ac6f8d9713 22 Ticker out;
okano 6:0121755ba84b 23 int in_flag = 0;
okano 1:86ac6f8d9713 24 float amp;
okano 6:0121755ba84b 25 unsigned int count = 0;
okano 1:86ac6f8d9713 26 float ci = 1.0;
okano 7:9522d9848470 27 float ref_tone;
okano 2:225f68a31496 28
okano 3:b72b559aaee0 29 #define SHORT_HIGH 0
okano 3:b72b559aaee0 30 #define SHORT_LOW 1
okano 3:b72b559aaee0 31 #define CONTROL_DIRECTION SHORT_LOW
okano 3:b72b559aaee0 32
okano 2:225f68a31496 33 enum Tone_list {
okano 2:225f68a31496 34 Tone_A = 0,
okano 2:225f68a31496 35 Tone_Ais,
okano 4:c06860b7a4ea 36 Tone_H,
okano 2:225f68a31496 37 Tone_C,
okano 2:225f68a31496 38 Tone_Cis,
okano 2:225f68a31496 39 Tone_D,
okano 2:225f68a31496 40 Tone_Dis,
okano 2:225f68a31496 41 Tone_E,
okano 2:225f68a31496 42 Tone_Eis,
okano 2:225f68a31496 43 Tone_F,
okano 2:225f68a31496 44 Tone_G,
okano 2:225f68a31496 45 Tone_Gis,
okano 2:225f68a31496 46 };
okano 2:225f68a31496 47
okano 7:9522d9848470 48 #define REFERENCE_TONE ((float)Tone_C)
okano 7:9522d9848470 49 #define REFERENCE_PITCH 442.0
okano 7:9522d9848470 50
okano 2:225f68a31496 51 void init( void );
okano 6:0121755ba84b 52 void set_in_flag();
okano 9:fb5f6209a33b 53 void data_output();
okano 2:225f68a31496 54
okano 3:b72b559aaee0 55 int main()
okano 3:b72b559aaee0 56 {
okano 2:225f68a31496 57 float ai;
okano 5:bb232622e1fc 58 int vc = 0;
okano 6:0121755ba84b 59
okano 2:225f68a31496 60 init();
okano 3:b72b559aaee0 61
okano 2:225f68a31496 62 while(1) {
okano 6:0121755ba84b 63 if ( in_flag ) {
okano 6:0121755ba84b 64 in_flag = 0;
okano 8:5af7a442e39a 65
okano 9:fb5f6209a33b 66 //
okano 9:fb5f6209a33b 67 // output amplitude
okano 9:fb5f6209a33b 68 //
okano 7:9522d9848470 69 amp = (key0 < SQUELCH) ? 0.0 : key0 * 2.0;
okano 8:5af7a442e39a 70
okano 9:fb5f6209a33b 71 //
okano 9:fb5f6209a33b 72 // output frequency
okano 9:fb5f6209a33b 73 //
okano 6:0121755ba84b 74 ai = distanceSensor.rd();
okano 3:b72b559aaee0 75
okano 3:b72b559aaee0 76 #if (CONTROL_DIRECTION == SHORT_HIGH)
okano 11:a591cfa45d4e 77 ci = (2.25 - ai * 2.0);
okano 3:b72b559aaee0 78 #else
okano 11:a591cfa45d4e 79 ci = (0.75 + ai * 2.0);
okano 3:b72b559aaee0 80 #endif
okano 9:fb5f6209a33b 81 //
okano 9:fb5f6209a33b 82 // reference tone indicator
okano 9:fb5f6209a33b 83 //
okano 9:fb5f6209a33b 84 leds = 0x0;
okano 9:fb5f6209a33b 85 if ( (0.943874 < ci) && (ci < 1.05946) ) {
okano 9:fb5f6209a33b 86 leds = 0x1;
okano 9:fb5f6209a33b 87 }
okano 9:fb5f6209a33b 88 if ( (0.971532 < ci) && (ci < 1.0293) ) {
okano 9:fb5f6209a33b 89 leds = 0x3;
okano 9:fb5f6209a33b 90 }
okano 9:fb5f6209a33b 91 if ( (0.985663 < ci) && (ci < 1.01455) ) {
okano 9:fb5f6209a33b 92 leds = 0x7;
okano 9:fb5f6209a33b 93 }
okano 3:b72b559aaee0 94
okano 6:0121755ba84b 95 vitalsign = (vc++ >> 4) & 0x1;
okano 6:0121755ba84b 96 }
okano 2:225f68a31496 97 }
okano 2:225f68a31496 98 }
okano 0:cc77dd0427d8 99
okano 8:5af7a442e39a 100
okano 8:5af7a442e39a 101
okano 8:5af7a442e39a 102 float waveform_generator( int i )
okano 8:5af7a442e39a 103 {
okano 11:a591cfa45d4e 104 #define WAVEFORM_SIN
okano 8:5af7a442e39a 105 //#define WAVEFORM_SAWTOOTH
okano 11:a591cfa45d4e 106 //#define WAVEFORM_CUSTOM_HARMONICS
okano 8:5af7a442e39a 107
okano 8:5af7a442e39a 108 float r;
okano 8:5af7a442e39a 109
okano 8:5af7a442e39a 110 #ifdef WAVEFORM_SAWTOOTH
okano 8:5af7a442e39a 111 r = (float)i / (float)N_SAMPLES;
okano 8:5af7a442e39a 112 #endif
okano 8:5af7a442e39a 113
okano 8:5af7a442e39a 114 #ifdef WAVEFORM_SIN
okano 8:5af7a442e39a 115 r = sin( 2.0 * PI * ((float)i / (float)N_SAMPLES) );
okano 8:5af7a442e39a 116 #endif
okano 8:5af7a442e39a 117
okano 8:5af7a442e39a 118 #ifdef WAVEFORM_CUSTOM_HARMONICS
okano 8:5af7a442e39a 119
okano 8:5af7a442e39a 120 typedef struct element_st {
okano 8:5af7a442e39a 121 float frequency;
okano 8:5af7a442e39a 122 float amplitude;
okano 8:5af7a442e39a 123 float phase;
okano 8:5af7a442e39a 124 }
okano 8:5af7a442e39a 125 element;
okano 8:5af7a442e39a 126
okano 9:fb5f6209a33b 127 #define REF_AMPLITUDE 1.0
okano 9:fb5f6209a33b 128 static element e[] = {
okano 8:5af7a442e39a 129 { 1.0, REF_AMPLITUDE / 1.0, 0 * PI },
okano 8:5af7a442e39a 130 // { 2.0, REF_AMPLITUDE / 2.0, 0 * PI },
okano 8:5af7a442e39a 131 { 3.0, REF_AMPLITUDE / 3.0, 0 * PI },
okano 8:5af7a442e39a 132 // { 4.0, REF_AMPLITUDE / 4.0, 0 * PI },
okano 8:5af7a442e39a 133 { 5.0, REF_AMPLITUDE / 5.0, 0 * PI },
okano 8:5af7a442e39a 134 // { 6.0, REF_AMPLITUDE / 4.0, 0 * PI },
okano 8:5af7a442e39a 135 { 7.0, REF_AMPLITUDE / 7.0, 0 * PI },
okano 9:fb5f6209a33b 136 // { 3.33333, REF_AMPLITUDE / 2.0, 0 * PI },// nonintegral harmonics
okano 9:fb5f6209a33b 137 // { 11.9311, REF_AMPLITUDE / 2.0, 0 * PI },// nonintegral harmonics
okano 8:5af7a442e39a 138 };
okano 8:5af7a442e39a 139
okano 8:5af7a442e39a 140 float f;
okano 8:5af7a442e39a 141 r = 0.0;
okano 8:5af7a442e39a 142
okano 8:5af7a442e39a 143 for ( int x = 0; x < sizeof( e ) / sizeof( element ); x++ ) {
okano 8:5af7a442e39a 144 f = e[ x ].frequency * 2.0 * PI * ((float)i / (float)N_SAMPLES);
okano 8:5af7a442e39a 145 r += e[ x ].amplitude * cos( e[ x ].phase ) * sin( f );
okano 8:5af7a442e39a 146 r += e[ x ].amplitude * sin( e[ x ].phase ) * cos( f );
okano 8:5af7a442e39a 147 }
okano 8:5af7a442e39a 148 #endif
okano 8:5af7a442e39a 149 return ( r );
okano 8:5af7a442e39a 150 }
okano 8:5af7a442e39a 151
okano 0:cc77dd0427d8 152 void init( void )
okano 0:cc77dd0427d8 153 {
okano 9:fb5f6209a33b 154 //
okano 9:fb5f6209a33b 155 // prepare waveform table in RAM
okano 9:fb5f6209a33b 156 //
okano 3:b72b559aaee0 157 for ( int i = 0; i < N_SAMPLES; i++ ) {
okano 8:5af7a442e39a 158 sample[ i ] = (short)(32767.0 * waveform_generator( i ));
okano 0:cc77dd0427d8 159 }
okano 2:225f68a31496 160
okano 9:fb5f6209a33b 161 //
okano 9:fb5f6209a33b 162 // set reference tone coefficient
okano 9:fb5f6209a33b 163 //
okano 7:9522d9848470 164 ref_tone = (REFERENCE_PITCH * pow( 2.0, REFERENCE_TONE / 12.0 )) /K2 * K;
okano 8:5af7a442e39a 165
okano 9:fb5f6209a33b 166 // I2C clock frequency (option)
okano 6:0121755ba84b 167 i2c.frequency( 400 * 1000 );
okano 3:b72b559aaee0 168
okano 9:fb5f6209a33b 169 //
okano 9:fb5f6209a33b 170 // set periodic interrupt to sample user inputs
okano 9:fb5f6209a33b 171 //
okano 9:fb5f6209a33b 172 in.attach( &set_in_flag, 1.0 / 200.0 );
okano 7:9522d9848470 173
okano 9:fb5f6209a33b 174 //
okano 9:fb5f6209a33b 175 // set periodic interrupt to output sound data
okano 9:fb5f6209a33b 176 //
okano 9:fb5f6209a33b 177 out.attach( &data_output, 1.0 / ((float)(N_SAMPLES / K) * K2) );
okano 9:fb5f6209a33b 178
okano 9:fb5f6209a33b 179 // printf( "output sampling freq = %f kHz\r\n", ((float)(N_SAMPLES / K) * K2) / 1000.0 );
okano 0:cc77dd0427d8 180 }
okano 0:cc77dd0427d8 181
okano 6:0121755ba84b 182 void set_in_flag()
okano 6:0121755ba84b 183 {
okano 6:0121755ba84b 184 in_flag = 1;
okano 6:0121755ba84b 185 }
okano 6:0121755ba84b 186
okano 9:fb5f6209a33b 187 void data_output()
okano 6:0121755ba84b 188 {
okano 6:0121755ba84b 189 ao = 0.5 + (amp * ((float)sample[ count & 0x3FFF ] / 65536.0));
okano 7:9522d9848470 190 count += (int)(ref_tone * ci);
okano 0:cc77dd0427d8 191 }