USPatentGranted
B1

Reverberation generation processor

Granted 20 Apr 2004 · no office action yet

Application
10/295,947
filed 18 Nov 2002
Publication
Not published
not published
Patent· this page
US 6,723,910
granted 20 Apr 2004

Life of the patent

2 dated events
⤢ drag to zoomOct 2002Jan 2003Apr 2003Jul 2003Oct 2003Jan 2004Apr 2004Prosecution
Prosecutionhover for detail · click to open

Abstract

A reverberation generation processor. The reverberation generation processor generates a specific auditory signal according to a predetermined virtual environment having characteristics of spatial dimension, sound reflection, and decline. The natural sequence generator generates a natural sequence having a predetermined number of items according to the characteristics of the virtual environment. The sequence adjusting device adjusts gains of the items and a time scale between the items of the natural sequence and outputs an audio signal. The filter processor filters a predetermined frequency band of the audio signal according to the characteristics of the virtual environment and divides the filtered audio signal into a high frequency audio signal and a low frequency audio signal. The high frequency reverberation generator transforms the high frequency audio signal to a high frequency reverberation signal. The low frequency reverberation generator transforms the low frequency audio signal to a low frequency reverberation signal. The output device combines the high frequency reverberation signal and the low frequency reverberation signal to output the specific auditory signal.

Description

4 parts
›BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates in general to a reverberation generation processor. In particular, the present invention relates to a reverberation generation processor for simulating a virtual environment.

2. Description of the Related Art

Virtual auditory displays (including computer games, virtual reality systems or computer music workstations) create virtual worlds in which a virtual listener can hear sounds generated from sound sources within these worlds. In addition to reproduce sound as generated by the source, the computer also processes the source signal to simulate the effects of the virtual environment on the sound emitted by the source. In a computer game, the player hears the sound that he/she would hear if he/she were located in the position of the virtual listener in the virtual world.

One important environmental factor is reverberation, which refers to the reflections of the generated sound which bounce off objects in the environment. Reverberation can be characterized by measurable criteria, such as the reverberation time, which is a measure of the time it takes for the reflections to become imperceptible.

FIG. 1 is a graph depicting the time and intensities of the direct sound, early reflection, and late reverberation components. The first signal that reaches the listener is the direct signal which undergoes no reflection. Subsequently, a series of discrete “early” reflections are received during an initial period of the reverberation response. Finally, after a critical time, the “late” reverberation is modeled statistically because of the combination and overlapping of the various reflections. The magnitudes of Reflections_delay and Reverb_delay are typically dependent on the size of the room and on the position of the source and the listener in the room.

Research continues in methods to create realistic sounds in virtual reality and gaming environments. However, the related circuits are complicated.

›SUMMARY OF THE INVENTION

The object of the present invention is to provide a reverberation generation processor to simulate the reverberation effect as shown in FIG. 1 .

To achieve the above-mentioned object, the present invention provides a reverberation generation processor for generating a specific auditory signal according to a predetermined virtual environment having characteristics of spatial dimension, sound reflection, and decline. The natural sequence generator generates a natural sequence having a predetermined number of items according to the characteristics of the virtual environment. The sequence adjusting device adjusts gains of the items and a time scale between the items of the natural sequence and outputs an audio signal. The filter processor filters a predetermined frequency band of the audio signal according to the characteristics of the virtual environment and divides the filtered audio signal into a high frequency audio signal and a low frequency audio signal. The high frequency reverberation generator transforms the high frequency audio signal to a high frequency reverberation signal. The low frequency reverberation generator transforms the low frequency audio signal to a low frequency reverberation signal. The output device combines the high frequency reverberation signal and the low frequency reverberation signal to output the specific auditory signal.

›BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will become more fully understood from the detailed description given hereinbelow and the accompanying drawings, given by way of illustration only and thus not intended to be limitative of the present invention.

FIG. 1 is a graph depicting the time and intensities of the direct sound, early reflection, and late reverberation components.

FIG. 2 shows a block diagram of the reverberation generation processor according to the embodiment of the present invention.

FIG. 3 shows the structures of the high frequency reverberation generator and the low frequency reverberation generator according to the embodiment of the present invention.

›DETAILED DESCRIPTION OF THE INVENTION

The reverberation generation processor according to the embodiment of the present invention is applied to computer games, virtual environment systems or electrophonic music systems. The reverberation effects are generated according to the parameters of the virtual environment, such as spatial dimension, sound reflection and decline and the medium in the virtual environment for transmitting sound.

FIG. 2 shows a block diagram of the reverberation generation processor according to the embodiment of the present invention. The natural sequence generator 20 generates a Fibonnacci sequence having a predetermined number of items according to the characteristics of the virtual environment. The pulses of the Fibonnacci sequence are [ 1 , 2 , 3 , 5 , 8 , 13 . . . ]. The general formula of Fibonnacci sequence is:

F n+2 =F n +F n+1 and F 0 =1 , F 1 =1.

Fibonnacci sequence fits in with the situation of the combination of sound. To model the different environment size and reflection coefficient, gain and time scales are applied. The used sequence length is according to the different environment sets. For example, when in a small and non-absorptive room, the sequence length is longer than in an open environment. When in a spacious environment, the time base set is multiplied by larger integers than with less spacious environments. If in an absorptive room, such as a carpeted lobby, the gain applied to each item is smaller than an uncarpeted one. In addition, the time scale of the sequence also depends on the environment sets. When in a larger room, the sound reflected to a listener requires longer time, so the time between each item of the sequence is larger. If in a smaller room, the sound is reflected to the listener immediately, so the time between each item of the sequence is smaller. Here, the gain and time scale are set by the sequence adjusting device 22 .

In addition, the sound decline is based on the air medium state. Therefore, the filter processor 24 filters a predetermined frequency band of the sound according to the characteristics of the air medium of the virtual environment. For example, the high frequency signal declines more sharply in a wet environment, so the filter processor 24 filters a portion of high frequency signal by a low pass filter to model the real effect. Moreover, the filtered signal is divided into a high frequency audio signal and a low frequency audio signal because the different frequency audio signals have different reverberation.

Next, the high frequency audio signal and the low frequency audio signal are input to a high frequency reverberation generator 26 and a low frequency reverberation generator 28 , respectively. FIG. 3 shows the structures of the high frequency reverberation generator and the low frequency reverberation generator according to the embodiment of the present invention. The high frequency reverberation generator 26 and the low frequency reverberation generator 28 comprise equal structures and generate high frequency reverberation signals and low frequency reverberation signals, respectively. The audio signals input by the filter processor 24 are delayed by the delay units 32 A- 32 D to generate reverberation signals and are then transmitted to the output device 30 . In addition, the output reverberation signals are fed back to matrix multipliers 35 A and 35 B and added to the parameter provided by the diagonal matrix 33 and constant matrix 34 . Here, the parameters of the matrix multipliers 35 A and 35 B in the high frequency reverberation generator 26 and the low frequency reverberation generator 28 are different because the reflection between high frequency audio signals and low frequency audio signals is different. In addition, the parameters are set up according to the spatial dimension, sound reflection, and decline of the virtual environment.

Finally, the high frequency reverberation signals and low frequency reverberation signals are output to an output device 30 . The output device can be a sound card, a microphone, or a musical instrument digital interface.

Accordingly, the reverberation generation processor according to the embodiment of the present invention using the audio signal in Fibonnacci sequence form simulates a vivid virtual environment according to the characteristics of the environment, such as spatial dimension, sound reflection and decline, provided by a soft program. Moreover, the present invention provides a reverberation generation processor with good performance and simplifies the circuit structure of the prior art.

The foregoing description of the preferred embodiments of this invention has been presented for purposes of illustration and description. Obvious modifications or variations are possible in light of the above teaching. The embodiments were chosen and described to provide the best illustration of the principles of this invention and its practical application to thereby enable those skilled in the art to utilize the invention in various embodiments and with various modifications as are suited to the particular use contemplated. All such modifications and variations are within the scope of the present invention as determined by the appended claims when interpreted in accordance with the breadth to which they are fairly, legally, and equitably entitled.

Claims

16 · 16 independent · depth 1
12345678910111213141516
16 granted claims

Classifications

5 codes
IPC · International Patent Classification
Section G — Physics
  • G10H1/00
  • G10K15/12
USPC · US Patent Classification
84/63084/66284/622

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this patent are not paired with the granted ones in what we hold.

File wrapper

Pendency
1.4 y
519 days filing → grant
Office actions
0
none on record
Examiner
Marlon T. Fletcher
art unit 2837 · TC 2800
Citations: 8 back · 5 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Chain of title

⤢ drag to zoom20022004200620082010201220142016201820202022Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock

Term & fees

See the term timeline — pendency span, in-force span, the maintenance fees paid and both computed expiry dates.

Log in to unlock

Validity challenges

See the validity challenges on record — reexaminations, IPRs and PGRs, with their institution decisions and outcomes.

Log in to unlock

Citations

See every patent this one cites and every patent that cites it back — publication, assignee, and how each one was found.

Log in to unlock