Tuning device for musical instruments and computer program used therein Number:7,521,618 from the United States Patent and Trademark Office (PTO) owispatent A portable tuning device includes a microphone, a data processing system and a touch-panel liquid crystal display device, and assists a user in a tuning work on an upright piano; when the user depresses a key, sound waves, which expresses a tone, are propagated to the microphone, and are converted to an audio signal, the waveform of which is converted to audio data codes; the data processing system firstly calculates an introductory autocorrelation on the audio data codes for a small number of delayed waveform so as to determine a register to which the tone belongs, and, thereafter, calculates a principal autocorrelation on the audio data codes for delayed waveforms within the register so as to estimate the pitch of the tone; since the compass is narrowed to the register through the introductory autocorrelation, the amount of calculation is relatively small in the principal autocorrelation.<H instruments, computer, Tuning, device, f, 7521618.html, Patent, pto, 7521618

Title: Tuning device for musical instruments and computer program used therein

Abstract: A portable tuning device includes a microphone, a data processing system and a touch-panel liquid crystal display device, and assists a user in a tuning work on an upright piano; when the user depresses a key, sound waves, which expresses a tone, are propagated to the microphone, and are converted to an audio signal, the waveform of which is converted to audio data codes; the data processing system firstly calculates an introductory autocorrelation on the audio data codes for a small number of delayed waveform so as to determine a register to which the tone belongs, and, thereafter, calculates a principal autocorrelation on the audio data codes for delayed waveforms within the register so as to estimate the pitch of the tone; since the compass is narrowed to the register through the introductory autocorrelation, the amount of calculation is relatively small in the principal autocorrelation.

Patent Number: 7,521,618 Issued on 04/21/2009 to Okuyama

Inventors: Okuyama; Fukutaro (Shizuoka-ken, JP)
Assignee: Yamaha Corporation (Shizuoka-Ken, JP)

Appl. No.: 11/480,208

Filed: June 30, 2006

Foreign Application Priority Data


Jul 04, 2005 [JP]			2005-194792

Current U.S. Class: 84/454 ; 84/455; 84/723

Current International Class: G10G 7/02 (20060101)

References Cited [Referenced By]

U.S. Patent Documents


4429609	February 1984	Warrender
5619004	April 1997	Dame
5973252	October 1999	Hildebrand
7049502	May 2006	Taku et al.
7268286	September 2007	Carpenter

Foreign Patent Documents


1335351	Aug., 2003	EP
09-257558	Oct., 1997	JP

Primary Examiner: Fletcher; Marlon T
Attorney, Agent or Firm: Harness, Dickey & Pierce, PLC

Claims

What is claimed is:

1. A tuning device for assisting a user in a tuning work on a musical instrument, comprising: a converter converting vibrations representative of a tone produced in said musical instrument to an electric signal representative of said vibrations; a data processing system connected to said converter, carrying out a multiple-step autocorrelation on a waveform of said electric signal, and narrowing down a frequency range featuring said tone so as to determine a certain register within which said tone is fallen through an earlier execution of said multiple-step autocorrelation and a pitch of said tone through a later execution of said multiple-step autocorrelation; and a man-machine interface connected to said data processing system, and visualizing a result of said multiple-step autocorrelation.

2. The tuning device as set forth in claim 1, in which said data processing system includes a first executor calculating an autocorrelation so as to determine said certain register within which said tone is fallen, and second executor calculating another autocorrelation for delayed waveforms corresponding to tones in said certain register so as to determine said pitch of said tone.

3. The tuning device as set forth in claim 2, in which said first executor has a preliminary calculating routine calculating said autocorrelation for assumptive waveforms delayed from said waveform by values of delay time, said values of delay time being selected in such a manner as to cause said autocorrelation for the assumptive waveforms of the waveforms expressing tones in a register to exhibit a tendency different from that of said autocorrelation for the assumptive waveforms of the waveforms expressing tones in another register, and a judging routine examining the result of said autocorrelation to see whether or not said autocorrelation for the assumptive waveforms delayed from said waveform exhibits either tendency and determining said certain register.

4. The tuning device as set forth in claim 3, in which said values of delay time are selected in such a manner that said autocorrelation for said assumptive waveforms in said register exhibits a polarity change different from that exhibited by said autocorrelation for said assumptive waveforms in said another register.

5. The tuning device as set forth in claim 3, in which said autocorrelation R(m) is expressed by .function..times..function..times..function. ##EQU00004## where x is samples expressing said waveform, M is the number of said samples and m is said values of delay time.

6. The tuning device as set forth in claim 3, in which said judging routine determines whether the values of said autocorrelation R(m) are found in one of the positive and negative regions or are changed between said negative region and said positive region, and judges one of the registers to be said certain register.

7. The tuning device as set forth in claim 2, in which said second executor includes a preliminary calculating routine calculating said another autocorrelation for assumptive waveforms delayed from said waveform and respectively expressing the tones in said certain register, and a judging routine searching the result of said another autocorrelation for a maximum value of said another autocorrelation and determining the wavelength of said waveform expressing said tone on the basis of the delay time introduced into one of the assumptive waveforms at said maximum value.

8. The tuning device as set forth in claim 7, in which said another autocorrelation is expressed by the following equation .function.'.times..times..times..function..times..function. ##EQU00005## where x is samples expressing said waveform, M1 is the number of samples and m is a value of delay time.

9. The tuning device as set forth in claim 7, in which said another autocorrelation is expressed by one of the following equations respectively used for the tones in said register and the tones in said another register .function.'.times..times..times..function..times..function. ##EQU00006## where x is samples expressing said waveform, M1 is the number of samples and m is a value of delay time, and .function.''.times..times..times..function..times..function. ##EQU00007## where x is samples expressing said waveform, M2 is the number of samples and m is a value of delay time.

10. The tuning device as set forth in claim 1, further comprising another data processing system connected to said converter and said man-machine interface, and producing a composite image expressing a phase difference between a target frequency of said tone and an actual frequency of said tone through an analysis on said waveform.

11. The tuning device as set forth in claim 10, in which said another data processing system includes a basic image producer connected to said converter, and producing plural basic images representative of a repetition period of a certain frequency component incorporated in said tone in such a manner that window time periods of said basic images are partially overlapped with one another, and a composite image producer connected to said basic image producer, superimposing said basic images in such a manner that a delay time is eliminated from between each of said window time periods and the next window time period following said each of said window time periods so as to produce said composite image, and causing said man-machine interface to visualize said composite image.

12. The tuning device as set forth in claim 11, in which said basic image producer produces each of said basic images from a series of pieces of waveform data assigned respective data positions, said composite image producer produces said composite image from a series of pieces of composite data, and each of said pieces of composite data is produced through an arithmetic mean on the pieces of waveform data each occupied at one of said data positions in one of the plural series of pieces of waveform data.

13. The tuning device as set forth in claim 11, said another data processing system further includes a time keeper connected to said basic image producer and said composite image producer and causing said basic image producer and said composite image producer to produce said basic images and said composite image at time intervals longer than each of said window time periods.

14. A computer program expressing a method for assisting a tuning work on a musical instrument, said method comprising the steps of a) converting vibrations representative of a tone produced in said musical instrument to an electric signal representative of said vibrations; b) accumulating pieces of data information representative of a waveform of said electric signal in a data storage; c) narrowing down a frequency range of said waveform featuring said tone through a multiple-step autocorrelation on said pieces of data information so as to determine a certain register within which said tone is fallen through an earlier execution of said multi-step autocorrelation and a pitch of said tone through a later execution of said multi-step autocorrelation; and d) visualizing a narrowed frequency range.

15. The computer program as set forth in claim 14, in which said step c) includes the sub-steps of c-1) calculating the autocorrelation on said pieces of data information so as to determine said certain register within which said tone is fallen, and c-2) calculating the autocorrelation for delayed waveforms corresponding to tones in said certain register so as to determine pitch of said tone.

16. The computer program as set forth in claim 15, in which said sub-step c-1) includes the sub-steps of c-1-1) calculating said auto correlation for assumptive waveforms delayed from said waveform by values of delay time, said values of delay time being selected in such a manner as to cause said autocorrelation for the assumptive waveforms of the waveforms expressing tones in a register to exhibit a tendency different from that of said autocorrelation for the assumptive waveforms of the waveforms expressing tones in another register, and c-1-2) examining the result of said autocorrelation to see whether or not said autocorrelation for the assumptive waveforms of said waveform expressing said tone exhibits either tendency and determining said certain register.

17. The computer program as set forth in claim 16, in which said autocorrelation R(m) is expressed by .function..times..function..times..function. ##EQU00008## where x is said pieces of data information on said waveform, M is the number of said pieces of data information and m is said values of delay time.

18. The computer program as set forth in claim 15, in which said sub-step c-2) includes the sub-steps of c-2-1) calculating said another autocorrelation for assumptive waveforms delayed from said waveform and respectively expressing tones in said certain register, and c-2-2) determining the amount of delay time introduced into one of said assumptive waveforms, said another autocorrelation of which is maximized in said sub-step c-2-2).

19. The computer program as set forth in claim 18, in which said another autocorrelation is expressed by the following equation .function.'.times..times..times..function..times..function. ##EQU00009## where x is said pieces of data information, M1 is the number of said pieces of data information and m is a value of delay time.

20. The computer program as set forth in claim 18, in which said another autocorrelation is expressed by one of the following equations respectively used for the tones in a register and the tones in another register .function.'.times..times..times..function..times..function. ##EQU00010## where x is said pieces of data information, M1 is the number of said pieces of data information and m is a value of delay time, and .function.''.times..times..times..function..times..function. ##EQU00011## where x is said pieces of data information, M2 is the number of said pieces of data information and m is a value of delay time.

Description

FIELD OF THE INVENTION

This invention relates to a tuning device for musical instruments and, more particularly, to a tuning device for judging the pitch of tones in a tuning work on musical instruments and a computer program used therein.

DESCRIPTION OF THE RELATED ART

The tuning device is designed to assist a user in a tuning work on a musical instrument. While the user producing tones in the musical instrument, the tuning device analyzes the sound waves for the pitch name, octave and difference from a target pitch, i.e., current tuning status of the musical instrument, and notifies the user of the current tuning status through visual images.

A typical example of the prior art tuning device is disclosed in Japanese Patent Publication No. Hei 3-42412. The prior art method disclosed in the Japanese Patent Publication is hereinafter briefly described. While the sound waves are being supplied from a musical instrument to the prior art tuning device, the tuning device converts the sound waves to an audio input signal, and produces a pulse train from the audio input signal. While the audio input signal is keeping the potential level over zero, the prior art tuning device also keeps the pulse at the high level. The pulse is decayed to the low level at the decay of the audio input signal under zero. If the audio input signal keeps the potential level over zero for a long time, the corresponding pulse has a long pulse width. On the other hand, if the audio input signal raises the potential level over zero for a short time, the corresponding pulse shrinks the pulse width. For this reason, the irregular pulses form the pulse train, and the pulse width is variable.

The prior art tuning device introduces a delay time, which is equal to the time period from the first pulse rise over zero to the next pulse rise over zero, into the original pulse train, and produces the first delayed pulse train. A delay time, which is equal to the time period from the second pulse rise over zero to the third pulse rise over zero, is further introduced into the first delayed pulse train, and produces the second delayed pulse train. In this manner, the delay times, which are respectively equal to the pulse intervals of the original pulse train after the second pulse period, are successively introduced into the delayed pulse trains.

Subsequently, the prior art tuning device checks the delayed pulse trains for the correlation with the original pulse train. If the total amount of delay time is equal to the major repetition period of the audio input signal which strongly relates to the pitch of the tone, the correlation with the original pulse train is found to be high. On the other hand, if the total amount of delay time is different from the major repetition period of the audio input signal, the delayed pulse train has a low value of the correlation with the original pulse train. Thus, the pitch of tone on the sound waves is determinable through the correlation analysis on the delayed pulse trains in spite of undesirable influences of short repetition periods on the audio input signal. The prior art tuning device disclosed in the Japanese Patent Publication is hereinafter referred to as "the first prior art tuning device".

Another prior art tuning device, which is an improvement of the prior art tuning device disclosed in the Japanese Patent Publication, is disclosed in Japanese Patent Application laid-open No. Hei 9-257558. The prior art tuning device disclosed in the Japanese Patent Application laid-open compares the audio input signal with a threshold, which makes it possible to discriminate high-level peaks in the audio input signal, and another threshold, which makes it possible to discriminate low-level peaks in the audio input signal, and determines the high-level peaks and low-level peaks. The original pulse train is further produced from the audio input signal, and the delayed pulse trains are also produced from the original pulse train. The prior art tuning device determines the correlation between the original pulse train and each of the delayed pulse trains at the peaks, and further determines the pitch of tone on the basis of the total amount of delay time. The prior art tuning device disclosed in the Japanese Patent Application laid-open is hereinafter referred to as "the second prior art tuning device".

Yet another tuning method is further described in the Japanese Patent Application laid-open, and is hereinafter referred to as "the third prior art tuning device". Time delays are successively introduced into the audio input signal, and the third prior art tuning device determines the correlation between the delayed audio input signals and the audio input signal in the entirety of the waveforms.

A problem is encountered in the first prior art tuning device and second prior art tuning device in that the accuracy of the correlation is liable to be damaged with noises around the zero-crossing points and strong harmonic. A noise component is assumed to rapidly raise the potential level of the audio input signal over zero immediately before the pulse raise for the major repetition period. The noise makes the major repetition period longer than usual. As a result, the correlation is lowered. A strong harmonic also makes the major repetition period vague. An extremely large number of zero-cross points take place in the original pulse train, and each of the zero-cross points has a possibility of the strong correlation. For this reason, the first and second prior art tuning devices determine an extremely large number of delayed pulse trains at all the zero-crossing points, and have to carry out a huge amount of calculation for the correlation at all the zero-crossing points. As a result, the values of correlation at certain zero-crossing points are close to one another, and the influence of noise becomes serious.

A problem inherent in the third prior art tuning device is the large amount of calculation for the correlation. If a musical instrument is to be tuned at a large number of target pitches, a long time period is required for the tuning work so that the third prior art tuning device is less feasible.

SUMMARY OF THE INVENTION

It is therefore an important object of the present invention to provide a tuning device, which accurately determines an actual pitch of a tone without a large mount of calculation.

It is also an important object of the present invention to provide a computer program, which is loaded in the tuning device.

The present inventor contemplated the problem inherent in the prior art, and noticed that there were plural possibilities equal to the number of keys of a piano for each tone to be analyzed. Pianos typically had eighty-eight keys so that there were eighty-eight possibilities for each tone to be analyzed. In this situation, the autocorrelation was to be eighty-eighth times repeated for eighty-eight values of delay, which were equivalent to the eighty-eight repetition periods of the waveforms respectively expressing the eighty-eight piano tones. A large amount of calculation was required for the estimation on each piano tone.

The present inventor concentrated his effort how to reduce the amount of calculation. The present inventor noticed that the autocorrelation was to be focused on candidates in a register in which the tone to be analyzed was possibly found.

To accomplish the object, the present invention proposes stepwise to narrow down a frequency range of a waveform representing a tone through a multiple-step autocorrelation or repetition of autocorrelation.

In accordance with one aspect of the present invention, there is provided a tuning device for assisting a user in a tuning work on a musical instrument comprising a converter converting vibrations representative of a tone produced in the musical instrument to an electric signal representative of the vibrations, a data processing system connected to the converter, and carrying out a multiple-step autocorrelation on a waveform of the electric signal so as stepwise to narrow down a frequency range featuring the tone, and a man-machine interface connected to the data processing system, and visualizing a result of the multiple-step autocorrelation.

In accordance with another aspect of the present invention, there is provided a computer program expressing a method for assisting a tuning work on a musical instrument, and the method comprises the steps of a) converting vibrations representative of a tone produced in the musical instrument to an electric signal representative of the vibrations, b) accumulating pieces of data information representative of a waveform of the electric signal in a data storage, c) narrowing down a frequency range of the waveform featuring the tone through repetition of autocorrelation on the pieces of data information and d) visualizing a narrowed frequency range.

BRIEF DESCRIPTION OF THE DRAWINGS

The features and advantages of the tuning device and computer program will be more clearly understood from the following description taken in conjunction with the accompanying drawings, in which

FIG. 1 is a schematic view showing the external appearance of a portable tuning device according to the present invention,

FIG. 2 is a block diagram showing the system configuration of an electronic system incorporated in the portable tuning device,

FIGS. 3A and 3B are front views showing visual images produced on a touch-panel liquid crystal display device of the portable tuning device,

FIG. 4 is a graph showing relation of fundamental frequency components of electric signals representative of sound waves of tones and basic images,

FIGS. 5A and 5B are views showing superimposition of the basic images to produce gradation images,

FIG. 6 is a flowchart showing a job sequence in a main routine program,

FIG. 7 is a flowchart showing a job sequence in a subroutine program for visualizing phase difference,

FIGS. 8A and 8b are views showing a superimposition of basic images,

FIG. 9 is a flowchart showing a job sequence of a subroutine program for estimation of an actual pitch,

FIG. 10 is a flowchart showing a job sequence of a subroutine program for an autocorrelation,

FIG. 11 is a view showing a variable used in an autocorrelation for a piano,

FIG. 12A is a graph showing relation between the variable and the autocorrelation,

FIG. 12B is a graph showing the maximum value of the autocorrelation for a tone in a higher register,

FIG. 12C is a graph showing the maximum value of the autocorrelation for a tone in a lower register, and

FIG. 13 is a front view showing a touch-panel liquid crystal display panel incorporated in another tuning device according to the present invention, and

FIG. 14 is a flowchart showing a job sequence carried out in the tuning device.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

A tuning device embodying the present invention is used in a tuning work on a musical instrument. In other words, the user tunes the musical instrument with the assistance of the portable tuning device.

The tuning device comprises a converter, a data processing system connected to the converter and a man-machine interface connected to the data processing unit. When a tone is produced in the musical instrument, vibrations, which are representative of the tone, are input to the converter, and the converter converts the vibrations to an electric signal representative of said vibrations. Pieces of data information expressing the tone form a waveform of electric signal, and the electric signal is supplied to the data processing unit.

The data processing system carries out a multiple-step autocorrelation on the waveform of the electric signal, and analyzes frequency characteristics of the electric signal such as a periodicity of certain frequency components through the multiple-step autocorrelation. At least two sorts of autocorrelations are incorporated in the multiple-step autocorrelation. A relatively wide frequency range, which is strongly correlated with the waveform, is firstly determined through one of the at least two sorts of autocorrelations, and the frequency range is narrowed down through the other sort or sorts of autocorrelations carried out in the relatively wide frequency range. The narrowed frequency range precisely expresses the frequency characteristics of the electric signal and, accordingly, the tone. The load on the data processing system for the other sort or sorts of autocorrelations is light, because the relatively wide frequency range is narrower than the whole frequency range is. Thus, the reduction in load makes the feature of tone clear.

First Embodiment

Referring to FIG. 1 of the drawings, a portable tuning device 1 embodying the present invention is designed to assist a user in a tuning work on an upright piano 2, and is provided as a PDA (Personal Digital Assistants).

The portable tuning device 1 comprises a housing 1a, a data processing system 1b, which will be hereinlater described with reference to FIG. 2, a touch-panel display device 3 and a microphone 4. The data processing system 1b is provided inside the housing 1a, and the touch-panel display device 3 is set in the housing 1a. The microphone 4 is connected to a connecting cable 4a, and a plug 4b, which is provided on the other end of the connecting cable 4a, is inserted in a jack (not shown) on the housing 1a.

A user directs the microphone 4 to the upright piano 2, and depresses one of the black and white keys. The key motion gives rise to vibrations of the associated string, and sound waves, which express a tone, are propagated to the microphone 4. The portable tuning device 1 accomplishes at least two tasks, i.e., determines the pitch name of a tone, and visualizes the phase difference between the target pitch and the actual pitch of the tone.

The data processing system 1b is connected to the touch-panel display device 3, and is further connected to the microphone 4 through the jack (not shown) and connecting cable 4a. The touch-panel display device 3 serves as a man-machine interface so that users are communicable with the data processing system 1b through the touch-panel display device 3. In this instance, a liquid crystal display panel and a transparent conductive film form in combination the touch-panel display device 3. The tones are converted to an analog audio signal through the microphone 4, and the audio signal is supplied to the data processing system 1b.

As shown in FIG. 2, the data processing system 1b includes a central processing unit 10, which is abbreviated as "CPU", a read only memory 11, which is abbreviated as "ROM", a random access memory 12, which is abbreviated as "RAM", a signal interface 13, a graphic controller 14, a touch-panel controller 15 and a shared bus system 16. The central processing unit 10, read only memory 11, random access memory 12, signal interface 13, graphic controller 14 and touch-panel controller 15 are connected to the shared bus system 16 so that the central processing unit 10 is communicable with those system components 11, 12, 13, 14 and 15. The central processing unit 10, read only memory 11, random access memory 12 and a part of the shared bus system 16 may be integrated on a monolithic semiconductor chip as a microcomputer.

A computer program is stored in the read only memory 11, and the instruction codes, which form the computer program, are sequentially read out from the read only memory 11 to the shared bus system 16. The instruction codes thus read out onto the shared bus system 16 are fetched by the central processing unit 10, and are executed for accomplishing a given task. The computer program includes a main routine program and subroutine programs.

The central processing unit 10 is an origin of the data processing capability, and achieves jobs through the execution of the instruction codes. When a user supplies electric power to the data processing system 1b, the main routine program starts to run on the central processing unit 10. The central processing unit 10 firstly initializes the data processing system 1b, and waits for a user's instruction. Several jobs in the main routine program will be hereinlater described.

One of the subroutine programs is assigned to visualization of the difference between the actual frequency of a tone and the target frequency of the tone. When a user instructs the data processing system 1b to assist him or her in the tuning work on the upright piano 2, the main routine program starts to run on the central processing unit 10, and periodically branches to the subroutine program for the visualization. Another of the subroutine programs is assigned to estimation of the pitch name of a tone produced in the musical instrument, and the main routine program periodically branches to the subroutine program for the estimation of the pitch name. In this instance, the portable tuning device 1 estimates the actual pitch through a two-step autocorrelation. The autocorrelation makes it possible to estimate the periodicity of an input periodic signal.

The random access memory 12 offers a working area to the central processing unit 10. A digital audio signal or a series of audio data codes is accumulated in the random access memory 12 in the tuning work, and the central processing unit 10 examines the series of audio data codes to see how many frequencies the analog audio signal is assumed to have and whether or not a tone, which is expressed by the series of audio data codes, has an actual pitch equal to a target pitch.

The signal interface 13 has an amplifier and an analog-to-digital converter, and the analog audio signal is supplied from the microphone 4 to the amplifier. The analog audio signal is amplified through the amplifier, and is supplied to the analog-to-digital converter after the amplification. The analog audio signal is sampled at regular time intervals, and the discrete values on the analog audio signal are converted to the audio data codes. The pieces of audio data are relayed from the analog audio signal to the series of audio data codes. In this instance, the sampling frequency is adjusted to 44.1 kilo-hertz. The central processing unit 10 periodically fetches the audio data codes from the signal interface 13, and accumulates the audio data codes in the random access memory 12.

The graphic controller 14 is connected to the liquid crystal display panel of the touch-panel display device 3. The graphic controller 14 produces visual images on the liquid crystal display panel under the control of the central processing unit 10. Visual images form pictures, and each picture appears on the liquid crystal display panel over a frame or frames. The images of the pictures will be hereinlater described in detail. The picture is changed to a new picture or maintained in the next frame. Standard personal digital assistants usually repeat the frames at 15 Hz to 20 Hz. The frame frequency is less than the pitch of the lowest tone produced through the upright piano 2.

The touch-panel controller 15 is connected to the transparent conductive film of the touch-panel display device 3, and cooperates with the graphic controller 14. The touch-panel controller 15 provides a coordinate on the visual images produced on the liquid crystal display panel. When a user pushes a part of the transparent conductive film overlapped with a visual image with a suitable tool such as, for example, a pen, the touch-panel controller 15 determines the visual image on the liquid crystal display panel. In case where the visual images express some instructions, the central processing unit 10 recognizes the user's instruction through the image or images specified by the touch-panel controller 15.

FIGS. 3A and 3B show different pictures 30a and 30b produced on the touch-panel display device 3. The pictures 30a and 30b have at least four areas 31, 33, 34 and 35. The area 31 is assigned to gradation images 32a, 32b, . . . , which express the degree of phase difference between the actual waveform of the analog audio signal and the target waveform. The target waveform is representative of a target pitch or target frequency to which the musical instrument is to be tuned. An actual signal period or an actual repetition period is determined on the basis of the actual waveform, and the repetition period is the inverse of an actual frequency.

Although the gradation image 32a is produced from two tones, at least three tones or shades, i.e., lighter, darker and intermediate shades form the gradation image 32b. The gradation image 32a, which is produced from the two tones, expresses the consistency in phase between the actual waveform of audio signal and the target waveform. On the other hand, when a certain degree of phase difference takes place between the actual waveform of audio signal and the target waveform, the gradation image 32b, which is formed by more than two tones, appears in the area 31. If the phase difference is different from that expressed by the gradation image 32b, another gradation image, which is also produced from more than two tones, is produced on the touch-panel display device 3 as will be hereinlater described in detail.

The areas 33 and 35 are assigned to images of button switches. "7B", "8", "9", "res", "ver", "4F", "5G", "6A", "-10", "+10", "1C", "2D", "3E", "-", "+", "0", "b" and "#" are enclosed with rectangles, which express the peripheries of the button switches. The button switches "7B", "4F", "5G", "6A", "1C", "2D" and "3E" are shared between the numerals "7", "4", "5", "6", "1", "2" and "3" and the alphabets "B", "F", "G", "A", "C", "D" and "E". The alphabets express pitch names. Users specify a pitch name and an octave by pressing the button switches with the tool. When a user pushes the image of button switch "Tools", a job list is displayed on the entire area instead of the images shown in FIGS. 3A and 3B.

The area 34 is assigned to pieces of tuning information. Abbreviations "oct-note", "keyNo.", "cent" and "freq" are labeled with four sub-areas in the rectangle. The abbreviations "oct-note", "keyNo.", "cent" and "freq." and visual images produced below the abbreviations are hereinafter described in detail.

The visual images below the abbreviation "oct-note" express a pitch name assigned the tone to be targeted and an octave where the tone belongs. The visual image "5-A" means that the tone to be targeted is A in the fifth octave. The central processing unit 10 determines the pitch name and octave through execution of a subroutine program, and informs the user of the pitch name and octave through the visual images in the sub-areas below the abbreviation "oct-note".

The visual image below the abbreviation "keyNo." expresses the key number assigned the key at "5-A". The upright piano 2 has eighty-eight black and white keys, and the key numbers "1" to "88" are assigned to the eighty-eight black and white keys. The pitch name A in the fifth octaves is assigned to the key with the key number "49".

The visual image below the abbreviation "cent" expresses the interval between two tones. As well know to the persons skilled in the art, a whole tone in the temperament is equivalent to 200 cents, and, accordingly, the semitone is equivalent to 100 cents. When a user wishes to specify a tone offset from the tone "5-A" by a quarter tone, he or she inputs "50" cents through the visual images of button switches. When the visual images of "00" is produced in the sub-area below "cent" as those in FIGS. 3A and 3B, the tone is to be found just at A in the fifth octave.

The visual images below the abbreviation "freq." express the target frequency corresponding to the target pitch to which the musical instrument is to be tuned during data input by a user. A frequency, which is corresponding to the designated pitch name, is to be modified with the interval "cent" for the target pitch "freq.". In FIGS. 3A and 3B, numeral images "440.00" is read in the sub-area under the abbreviation "freq" together with the pitch name "5-A" and interval "00". This means that the tone "A" in the fifth octave, which is produced through the musical instrument 2, is to be found at 440.00 hertz. Though not shown in the drawings, while the portable tuning device 1 is assisting the user in the tuning work on the upright piano 2, the portable tuning device 1 can estimate the target frequency of a tone produced in the upright piano 2 without user's designation, and produces a visual image of the target frequency.

At the beginning of the tuning work, a user may specify a value of the target pitch through the data input for the standard pitch, pitch name, octave and interval through the manipulation on the images of button switches. As described hereinlater in detail, the portable tuning device 1 can estimate the tone at a certain pitch. In case where the portable tuning device 1 determines the pitch name on the basis of the estimated pitch, the user inputs only the standard pitch and interval.

In both cases, the central processing unit 10 causes the graphic controller 14 to produce the visual images expressing the pitch name, octave and interval in cent below the abbreviations "oct-note" and "cent". The central processing unit 10 determines the key number on the basis of the pitch name and octave, and further determines the fundamental frequency on the basis of the pitch name, octave and interval. The fundamental frequency features the tone assigned the target pitch name, and serves as the target pitch in this instance.

In order quickly to determine the key number and frequency, the pitch names in several octaves, key number assigned to the black and white keys of a standard piano and values of fundamental frequency are correlated with one another for several values of the standard pitch in the read only memory 11. When a user inputs a value of the standard pitch, a pitch name and an octave through the touch-panel liquid crystal display device 3, the central processing unit 10 determines the pitch name in the given octave on the basis of the coordinates reported from the touch-panel controller 15, and accesses a table, which is assigned to the designated standard pitch, in the read only memory 11 with the pitch name in the given octave. Then, the fundamental frequency and key number are read out from the read only memory 12 to the central processing unit 10. The central processing unit 10 supplies pieces of visual data expressing the pitch name, octave, key number and target frequency to the graphic controller 14, and the visual images are produced in the area 34 under the control of the graphic controller 14.

If the user further inputs the interval from the tone assigned the pitch name, the visual image of which is presently produced in the area 34, the touch-panel controller 15 reports the coordinate of the visual image of button switch pushed by the user to the central processing unit 10, and the central processing unit 10 converts the interval from the cent to the hertz. The central processing unit 10 adds the interval expressed in hertz to the fundamental frequency, and supplies the pieces of visual data expressing the new fundamental frequency to the graphic controller 14. The visual image of interval in cent and visual image of new fundamental frequency are produced in the area 34 under the control of the graphic controller 14.

While the sound waves are being propagated from the upright piano 2 to the portable tuning device 1, the portable tuning device 1 analyzes the analog audio signal for the phase difference between the actual frequency and the target frequency, and visualizes the phase difference on the touch-panel liquid crystal display device 3. If a user instructs the portable tuning device to determine the pitch name, the portable tuning device 1 estimates the actual frequency of the tone through two-step autocorrelation, and determines the target frequency of the tone. Thus, the portable tuning device 1 can inform the user of the target pitch name together with the phase difference through the visual images. Thus, the portable tuning device 1 according to the present invention assists the user in the tuning work through the visual images of the phase difference and the visual image of the target pitch name.

The portable tuning device 1 according to the present invention has two modes of operation, i.e., a manual mode and an automatic mode. When a user designates the target pitch name, the portable tuning device 1 enters the manual mode, and visualizes the phase difference between the actual frequency and the target frequency through a gradation image or images. On the other hand, when a user specifies the standard pitch and interval without any designation of pitch name, the portable tuning device 1 enters the automatic mode. The portable tuning device 1 determines the target pitch name and phase difference in the automatic mode, and visualizes them. Thus, the main routine program and subroutine program for visualization of phase difference are common to both manual and automatic modes. For this reason, description is firstly made on the main routine program and subroutine program for visualization of phase difference, and the subroutine program for estimation of target pitch is described after the description on the main routine program and subroutine program for the determination of phase difference.

While the main routine program is running on the central processing unit 10, the user inputs the standard pitch, pitch name "oct-note", interval "cent" and size of window W. The main routine program periodically branches to a subroutine program for visualizing the phase difference. The main routine program and two subroutine programs will be hereinlater described in detail.

The subroutine program for visualization of phase difference expresses a method for producing the gradation image 32a and 32b so that the method is illustrated in reference to FIG. 4. One of the particular features of the method is directed to superimposition of basic images. The term "superimposition" expresses an act to register objects with one another. The gradation image 32a/32b, which expresses the degree of phase difference between each single actual waveform of the audio signal and a single target waveform at a target pitch, is produced from the basic images through the superimposition.

Some terms are hereinafter defined for the method according to the present invention. A "cycle time" is equivalent to the time period expressed by the gradation image. A "window" is a time period equal to a product between the inverse of a target frequency Hz and an arbitrary number, and is shorter than the cycle time. Users set a window to a designated size for the resolution of the gradation image as will be described hereinlater in detail. The inverse of target frequency Hz is labeled with "Hz'" in FIG. 4, and the window is two and half times longer than the inverse Hz' of target frequency in the graph shown in the figure.

A "basic image" expresses the actual waveform of fundamental frequency component of the audio signal appearing in each window, and a "polarity pattern" repeatedly takes place in the window. The fundamental frequency component expresses the actual frequency of the tone. The polarity pattern expresses a pair of negative potential region and positive potential region. A part of the polarity pattern, which expresses the negative potential region, and the remaining part of the polarity pattern, which expresses the positive potential region, are referred to as a "negative portion" and a "positive portion", respectively. When the fundamental frequency component of the audio signal changes the potential level from the negative to the positive, the polarity pattern starts. The positive portion continues through the rise of the audio signal and the decay of the audio signal, and is terminated at the potential change from the positive to the negative. On the other hand, when the fundamental frequency component of audio signal is changed to negative, the negative portion starts, and is continued until the potential change to the positive, again.

The portable tuning device 1 firstly samples discrete values on the audio signal, and accumulates the discrete values in the random access memory 12 as the pieces of audio data. Subsequently, the fundamental frequency component or actual frequency is extracted from the discrete values, and pieces of fundamental frequency data, which express the fundamental frequency component or actual frequency, are accumulated in the random access memory 12. Plural series of pieces of fundamental frequency data are extracted from the accumulated pieces of fundamental frequency data for plural windows. Each of the plural series of fundamental frequency data occupies one of the windows. The piece of fundamental frequency data at the head of a series is delayed from the piece of fundamental frequency data at the head of the previous set by the inverse Hz'. Thus, the delay time, which is equal to the inverse Hz' of target frequency, is introduced between each series of pieces of fundamental frequency data and the next series of pieces of fundamental frequency data.

The plural series of fundamental frequency data are converted to plural series of polarity data, respectively. The pieces of polarity data express the positive potential region and negative potential region of the fundamental frequency component, and are stored in the random access memory 12. Each series of polarity data expresses the basic image. Since the delay time is introduced between a series of pieces of fundamental frequency data and the next series of pieces of fundamental frequency data, each basic image is also delayed from the previous basic image by the time period equal to the inverse Hz' of target frequency, and is partially overlapped with the previous basic image.

Subsequently, the basic images or plural series of pieces of polarity data are registered with or superimposed onto one another. Although the polarity pattern occupies the time period equal to the repetition period of the actual frequency of audio signal inverse Hz', the delay time between the basic images is equal to the inverse Hz' of the target frequency. For this reason, the difference in phase between the actual frequency and the target frequency has an influence on the basic images. When the basic images are superimposed onto one another, each negative pattern and each positive pattern are exactly superimposed on the other negative patterns and the other positive patterns in so far as the signal period or repetition period of the actual frequency of audio signal is equal to the inverse Hz' of target frequency. If the signal period or repetition period is shorter than or longer than the inverse Hz' of target frequency is, the boundary between the negative portion and the positive portion of each basic image is offset from the boundary between the negative portion and the positive portion of the next basic image, and the amount of offset between the adjacent basic images is increased from the first boundary to the last boundary in each cycle time. When the portable tuning device 1 proceeds to the next cycle time, the basic images of the gradation image are changed from those in the present cycle time. As a result, the gradation image looks as if it is slightly moved. While the portable tuning device 1 is repeating the renewal of the gradation image from the cycle time to the next cycle time the user feels as if the gradation image flows from one side toward the other side in the area 31.

Users set the window for the resolution. The shorter the window is, the higher the resolution is. The superimposed basic images, i.e., the gradation image 31a/31b occupy the whole area 31. In order to produce the gradation image in the whole area 31, the portable tuning device 1 properly magnifies the gradation images, and the magnification ratio is varied depending upon the length of the window or size of window W.

When a user instructs the portable tuning device 1 to elongate the window, many basic images occupy the window so that the portable tuning device magnifies each basic image at relatively small magnification ratio, because the many basic images are adjusted to the constant length of the area 31. On the other hand, when the user instructs the portable tuning device to shorten the window, a few basic images occupies the window so that the portable tuning device magnifies each basic image at relatively large magnification ratio so as to make the gradation image 31a/31b occupy the whole area 31. Since the basic images are magnified, the amount of offset is also magnified, and the user can discriminate an extremely small amount of offset through the gradation image. Thus, a short window makes the difference in phase between the repetition period of the audio signal and the inverse Hz' of target frequency clearly visualized.

Assuming now that a user inputs pitch name of "A" in the fifth octave by selectively pushing the images of button switches in the area 33, the central processing unit 10 acknowledges the manual mode, and determines that the target pitch is 440.00 hertz. The user is assumed not to input the offset or interval from the target pitch. The central processing unit 10 requests the graphic controller 14 to produce the visual images "5-A", "49", "00" and "440.00" in the area 34 as shown in FIGS. 3A and 3B.

When the user depresses the key assigned the key number of 49, the piano tone is produced inside the upright piano 2, and the sound waves, which express the piano tone, are propagated to the microphone 4. The sound waves are converted to the audio signal by means of the microphone 4, and the audio signal is transferred through the connection cable 4a to the signal interface 13.

The audio signal is sampled at regular intervals, which is much shorter than the inverse Hz' of target frequency, and the fundamental frequency component is extracted from the discrete values on the audio signal. The pieces of fundamental frequency data, which express the fundamental frequency component, are accumulated in the random access memory 12. Each of the fundamental frequency components is representative of the actual frequency audio signal, and is labeled with 40a or 40b in FIG. 4.

Plural series of pieces of fundamental frequency data are extracted from the accumulated pieces of fundamental frequency data 40a or 40b. The delay time, which is equal to the inverse Hz' of target frequency, is introduced between each of the plural series of pieces of fundamental frequency data and the next series of pieces of fundamental frequency data.

The plural series of fundamental frequency data are converted to plural series of polarity data. In this instance, the positive discrete values and negative discrete values are replaced with "1" and "0", respectively. A bit string "1" expresses the positive portion of the polarity pattern, and is colored in black in FIG. 4. On the other hand, a bit string "0" expresses the negative portion of the polarity pattern, and is colored in white in FIG. 4. The single signal waveform of the fundamental frequency component 40a/40b of audio signal forms a pair of positive portion and negative portion so that the pieces of polarity data are expressed as pairs of positive and negative portions.

Since the window is two and half times longer than the inverse Hz' of target frequency, the central processing unit 10 extracts the plural series of pieces of polarity data for the windows, respectively, and the plural series of pieces of polarity data express the basic images 41a, 41b, 41c, 41d, 41e, . . . or 41f, 41g, 41h, 41i, . . . . The delay time, which is equal to the inverse Hz' of target frequency, is introduced between the adjacent two series of pieces of polarity data so that the basic images 41b, 41c, 41d, 41e, . . . or 41g, 41h, 41i, 41j, . . . are offset from the previous series of polarity data 41a, 41b, 41c, 41d, . . . or 41f, 41 g, 41h, 41i by the inverse Hz' of target frequency.

The fundamental frequency component of audio signal 40a swings the potential level at 440.00 hertz so that each signal waveform is equal in length to the inverse Hz' of target frequency. The positive portion is equal in length to half of the wavelength of the fundamental frequency component 40a of audio signal, and the negative portion is also equal to the other half of the wavelength of the fundamental frequency component 40a of audio signal. For this reason, the boundary between the positive portion and the negative portion is just aligned with the zero-cross point on the time base. Since the window is two and half times longer than the inverse Hz' of target frequency, the basic images 41a, 41b, 41c, 41d, 41e, . . . exactly occupy the windows, respectively. In other words, each of the basic images 41a, 41b, 41c, 41d, 41e, . . . is same as the other basic images 41b, 41c, 41d, 41e, . . . , 41a.

On the other hand, the fundamental frequency component 40b of audio signal has the wavelength longer than the inverse Hz' of target frequency so that each of the polarity patterns in the basic images 41f, 41g, 41h, 41i, 41j . . . becomes longer than the inverse Hz' of target frequency. The boundary between the positive portion and the negative portion is not aligned with the zero-cross point on the time base, and two and half polarity patterns can not occupy the single window. As a result, the ratio between the positive portion and the negative portion in each window is varied, and the boundary between the positive portion and the negative portion is moved together with time.

The central processing unit 10 compares the bit pattern of the series of pieces of polarity data with that of the other series of pieces of polarity data as if the images 41a, 41b, 41c, 41d, 41e, . . . or 41f, 41g, 41h, 41i, 41j, . . . are superimposed on one another as shown in FIG. 5A or FIG. 5B.

When the upright piano 2 produces the sound waves equivalent to the fundamental frequency component 40a of audio signal, the basic images 41a, 41b, 41c, 41d, 41e, . . . have the boundaries between the positive portions and the negative portions aligned with the boundaries of the other basic images 41b, 41c, 41d, 41e, . . . , 41a, and the basic images 41a, 41b, 41c, 41d and 41e are formed into the gradation image 32a as shown in FIG. 5A. Although the graphic controller 14 repeatedly produces the gradation image 32a in the area 32a at the renewal timing under the control of the central processing unit 10, the gradation image 32a is same as that in the previous cycle times. Thus, the portable tuning device informs the user that the upright piano 2 has been correctly tuned at the key number 49.

On the other hand, if the upright piano 2 produces the sound waves equivalent to the fundamental frequency component 40b of audio signal, the fundamental frequency component 40b of audio signal has the signal period longer than the inverse Hz' of target frequency, and, accordingly, the polarity pattern for the fundamental frequency component 40b of audio signal becomes longer than that for the fundamental frequency component 40a of audio signal. The window is also two and half times longer than the inverse Hz' of target frequency is. As a result, two-odd polarity patterns occupy the window. The delay time is also introduced between the basic images 41f, 41g, 41h, 41i, 41j, . . . and the next basic images 41g, 41h, 41i, 41j, . . . . When the basic images 41f, 41g, 41h, 41i, 41j, . . . are superimposed on one another as shown in FIG. 6B, the boundaries between the positive portions and the negative portions in the basic images 41g, 41h, 41i, 41j, . . . are offset from the boundaries between the positive portions and the negative portions in the basic images 41f, 41g, 41h, 41i, 41j, . . . by an extremely short time a1. As a result, the basic images 41f, 41g, 41h, 41i and 41j are formed into the gradation image 32b. The gradation image 32b is constituted by more than two tones, and is different from the gradation image 32a, which expresses the tone at the target pitch.

When the gradation image 32b is renewed, the basic images 41f, 41g, 41h, 41i, 41j are changed to different basic images 41k, . . . . Comparing the basic image 41f with the basic image 41k, it is understood that the boundaries between the positive portions and the negative portions are moved from the basic image 41f to the basic image 41k. For this reason, the user feels the gradation image 32b sidewardly moved in the area 31. While the graphic controller 14 is repeatedly producing the gradation image 32b, the user understands the difference from the target pitch through the movement of the gradation image 32b.

If the cycle time is equal to one of the common multiples between the signal period of the fundamental frequency component 40b of audio signal and the inverse Hz' of target frequency, the gradation images, which represent the difference from the target pitch, do not sidewardly flow in the area 31. However, more than two tones form the gradation images, which represent the difference from the target pitch. As a result, the user recognizes the difference from the target pitch. Thus, the user can determine whether the upright piano 2 has been tuned at the target pitches on the basis of the number of tones in the gradation images 32a and 32b.

The above-described tuning work is realized through execution on the computer program. The computer program is broken down into the main routine program and sub-routine programs as described hereinbefore. While the main routine program is running on the central processing unit 10, the portable tuning device 1 communicates with a user for jobs to be carried out, and adjusts itself to the conditions given by the user. FIG. 6 shows a part of the main routine program relating to the tuning work on the upright piano 2. One of the subroutine programs SB1 is assigned to the visualization of phase difference, i.e., the production of the gradation images 32a/32b, and is illustrated in FIG. 7. The main routine program and subroutine program SB1 are firstly described with reference to FIGS. 6 and 7.

The main routine program periodically branches to the subroutine program SB1, and the central processing unit 10 repeatedly produces the gradation images for the cycle times. Although the subroutine program SB1 is inserted between step 2 and step 3 of the main routine program, the main routine program branches to the subroutine program SB1 at every timer interruption regardless of the job in the main routine program.

A user is assumed to turn on the power switch of the portable tuning device 1. The central processing unit 10 initializes the data processing system 1b, and communicates with the user for tuning parameters. One of the tuning parameters is a value of the standard pitch. The standard pitch is a frequency at A to which all the musical instrument and singers relating to an ensemble are to be tuned. There have been proposed several values for the standard pitch such as 440 hertz, 442 hertz, 439 hertz and so forth. Other tuning parameters are the pitch name, interval in cent and a size of window "W".

Upon entry into the tuning work, the central processing unit 10 firstly requests the graphic controller 14 sequentially to produce prompt messages to the user on the touch-panel liquid crystal display device 3 as by step S1. The touch-panel controller 15 informs the central processing unit 10 of the coordinates of the areas pushed by the user, and the central processing unit 10 determines user's instruction, values and options as by step S2. First, the graphic controller 14 produces the numeral images of the candidates of the standard pitch. The user is assumed to push the area where the numeral image "440.000 hertz" is produced. Then, the central processing unit 10 decides the standard pitch to be 440.000 hertz with the assistance of the touch-panel controller 15. The central processing unit 10 further cooperates with the graphic controller 14 and touch-panel controller 15 in similar manners so as to determine the pitch name, interval in cent and size W of window. The user is assumed to input A in the fifth octave, 0 cent and the standard size, i.e., 2.5 times to the portable tuning device 1. The central processing unit 10 acknowledges that the pitch name, i.e., the target frequency Hz, interval and size W of window are 440 hertz, 0 cent and two and half, i.e., 2.5 times longer than the inverse Hz' of the target frequency Hz, respectively.

Upon completion of the jobs at steps S1 and S2, the main routine program gets ready to branch to the subroutine program SB1, and the graphic controller 14 produces the gradation image in the area 31 as by steps S3 and S4. The jobs at steps S3 and S4 are hereinlater described with reference to FIG. 7.

Subsequently, the central processing unit 10 cooperates with the graphic controller 14 and touch-panel controller 15 for a tuning curve as b