第4章 多媒体音频信息处理
DESCRIPTION
第4章 多媒体音频信息处理. 声音是多媒体信息的一个重要组成部分,也是表达思想和情感的一种必不可少的媒体。无论其应用目的是什么,声音的合理使用可以使多媒体应用系统变得更加丰富多彩。在多媒体系统中,音频可被用作输入或输出。输入可以是 自然语言或语音命令 ,输出可以是语音或音乐,这些都涉及到音频处理技术。. STOP. 4.1 音频信号及其概念 - PowerPoint PPT PresentationTRANSCRIPT
-
4 , STOP
-
4.1 4.1.1 19
-
CD---(Audio)
-
4.1.2 ,
-
Hello4-14-1 Hello
-
4.1.3 (Hz)(kHz)50005000Hz5kHz300Hz3000Hz20 Hz(Subsonic)20Hz20kHz(Audio)20kHz(Ultrasonic)
-
(4-2) (dB)4-2
-
4.1.4 A/DD/A A/DD/AAAnalog()DDigital ()A/D A/D4-3A/DD/A4-4CD A/D
-
4-3 8A/D4-4 A/DD/A
-
4.1.5
-
4.1.6
-
4-54-5 (AUDIO TEST)
-
SNR(Signal to Noise Ration)(dB)
-
MOS(Mean Opinion Score)MOS4. 4.1 MOS
MOS5(Excellent)4(Good)3(Fair)2(Poor)()1(Unacceptable)()
-
4 CD-DASuper HiFi(High Fidelity) FM(Frequency Modulation) AM(Amplitude Modulation) (Telephone) 4CD-DA
-
4-6 44-64
-
4.2 4-7 A/DA/D 4-7
-
4.2.1 2040(Shannon) (Sampling)
-
Nyquist CDPCM8000CD44.1kHz22050Hz
-
4.2.2 ()? 16(bit) 828(quantization levels)16,216
-
4.2 4.2
(Hz)(kHz)()
200-34008850-7000161620-15k37.81620-22k44.116
-
4.2.3 4-81000/1/1000A/D09100 9 4-8 1000Hz10
-
D/A4-84-94-9() 4-9 D/A
-
2000/204000/404-104-11D/A()
-
4-10 2000Hz204-11 4000Hz40
-
4-12 2000Hz20D/A 4-122000Hz20D/A
-
4.2.4 (PCM)PCM
-
ITU G.71135dB0.5
-
ISOCD-DA24()CIRCCD4.3CD-DA 4.3 CD-DA
QP41124124
-
4.3 4.3.1
-
4-134-13
-
()()
-
PCMADPCMATC
-
LPC(Linear Predictive Coding) CELPMP-LPCVSELP
-
4.3.2 PCM 1939Alec ReevesPCM(Pulse Code Modulation)PCM1962BellATTPCM(T1) PCMPCMPCMPCMPCM
-
4-14PCMA/D (B)BPCM
-
4-14
-
PCM (-Law)()()A(A-Law)()()
-
x(n)4-15PCM AA 8kHz16APCM864kb/sITU()G.711
-
4-15
-
4.3.3 CCITT1972G.711APCM64kb/s1984G.721ADPCM32kb/s3003400Hz(50Hz7kHz)CCITTG.72264kb/sISDNB
-
ISDNB(Bbearer) ISDN----BDBD 64KbpsB16KbpsD128Kbps23B64KbpsD30BD
-
CCITT198916kb/sAT&T Bell16kb/s(LD-CELP)(GSM)13kb/s(RPE-LTP)1989CTIACELPISO(MPEG)MPEGMPEGMPEGMPEG
-
MPEG12,4.448kHz44.1kHz32kHz32MPEG3MPEGMPEG32kb/s448kb/s
-
MUSICAM ASPEC 4.4 MPEG
(kb/s)1MUSICAM 1:4 384
2MUSICAM 1:6 1:8256 1923ASPEC1:10 1:12128 112
-
4.3.4 WAVVOCMP3 WAV WAVWindowsWAVWindowsWindowsWAV
-
WAVRIFF (Resource Interchange File Format)RIFFPCMWAV3 WAVMSADPCMA S=R D (r/8) N
-
VOC VOCCreative(Sound Blaster)Creative Sound Blaster()WindowsDOSCCITT A WAVVOCASCII
-
MPEG.MP1/.MP2/.MP3 MPEGMPEGMPEG(MPEG Audio Layer 1/2/3),MP1MP2MP3 MPEGMP1MP2416181MP3101121 MP3Internet(4-16),MP3
-
4-16 MP3InternetWINAMPMP3(4-17)4-17 MP3WINAMP
-
MP3WinampMP3MP3MMXMP3Winplay3MusicMatch RealAudio.RA/.RM/.RAM RealAudioRealNetworks(Streaming Audio)RealNetworksRealMedia28.8kb/sISDNCD
-
AIFF.AIF/.AIFF AIFF(Audio Interchange File Format),Macintosh
-
4.4 ()MPC
-
4.4.1 ADLIB- PC19842090 ADLIB,ADLIB
-
Creative (CREATIVE)1989ComdexPCSound Blaster Sound BlasterISA8D/ASound Blaster ProMPC1Sound Blaster Pro
-
Creative16bit44KHzSound Blaster 16CD2090 Creative1995Sound Blaster Awe 32SB Awe 32321MBMIDI(MIDIYAMAHAFM)
-
Sound Blaster 32Sound Blaster AWE643264326416SB AWE64Wave Effect28MBSound Font64MIDI
-
4.4.2 (4-18) 4-18
-
- MIDICODEC DSP(4-19) DSP
-
A/DDSPPCMDPCMADPCMWAVWAVDSPD/A 4-19 ESS
-
-CODEC CODEC IntelAC97CODEC CODECMIDICD
-
I/D(/),4-20FM(mute)()CD-ROMI/OI/O
-
4-20 Sound Blaster PCI64
-
CODECDACDAC CODEC20Hz20KHz PCMIDIMIDIMIDI(FM)(Wave Table)
-
DMAPCII/OIRQDMA 3.5mm (MIC IN)
-
(LINE IN)(LINE OUT)(SPK OUT) (REAR OUT) MIDI/(MIDI/Joystick)MIDI (SPDIF OUT)AC-3DTS (SPDIF IN)
-
4.4.3 Line inCODECA/D CODECD/A MIDID/A
-
4.4.4 CD44.1KHz16MIDI MIDIMIDI(.WAV), .MID.WAV.MID,MIDI MIDI,FMFM, ,
-
4(4.1)
-
DVDDVDDolby Digital (AC3)5.1 5.15.14.180Hz 5.1
-
WAVEMP3MIDIMP3OICQICQWAVE()PCIWave
-
I/O (LINE IN)(LINE OUT)(SPEAKERS OUT)MIDI(MIDI/JOYSTICK PORT)4-214-21
-
I/ODMAIRQ(Jumper) WAVCDMIDIWAV
-
ISA8Mb/sPCIISA,,,PCI133Mb/s,, PCIFMPC 98ISAPCI
-
4.4.5 CoolEdit CoolEdit ProSyntrillium 5WAV
-
3D/DSP64 56 Sound Forge Sound ForgeSonic FoundryFlashFlash, Sound Forge(wav)(avi)
-
Sound Forge, WAVWMARMAVIMP3Sound Forge 4.5 MIDI MIDI
-
4.5.1 MIDI MIDI(Musical Instrument Digital Interface)MIDIMIDIMIDI MIDI, MIDIMIDIMIDIMIDI
-
MIDI,,MIDI,, MIDIMIDIMIDIMIDIMIDI
-
4.5.2 MIDI MIDI MIDIMIDI MIDIMIDI
-
MIDI,4-22 4-22 MIDI
-
MIDIMIDI () 4-23
-
4-23
-
4-24 MIDI MIDIMIDI4-24
-
MIDIMIDI 4-25USBMIDI
-
4-25 USBMIDI
-
() MIDIRoland JV1080Yamaha MU100R4-26
-
4-26 ROLAND JV1080
-
128GMMIDI(Sound Blaster Live) Yamaha S-YXG100, Roland VSC88MIDIMIDIMIDI
-
(Sequencer) MIDI Yamaha QY7004-27 Cakewalk()
-
4-27 YAMAHA QY700
-
4.5.3 MIDI MIDIMIDIMIDIMIDI.MIDMIDIMIDIMIDIMIDI4-28
-
4-28 MIDI
-
MIDIMIDI MIDIMIDIMIDIMIDIMIDI
-
MIDINote On MessageMIDI()(Note NumberC=60)(Velocity38) Note-On/Channel # (1001 CCCC) Note Number (0NNN NNNN) Velocity (0VVV VVVV) MIDINote-Off MessageMIDI()Note-Off/Channel # 1001 CCCC Note Number (0NNN NNNN) Velocity (0VVV VVVV)
-
MIDIMIDIMIDIMIDIMIDIMIDI(synthesizer)MIDI
-
4.5.4 FM DSPMIDIFM FM FM2080John ChowningFM
-
FM FMROMROMFM
-
FM F(t)
-
AIcm FM183189FMFM9FM12(l12)6FM(1318)5 36() FM,(Vibrato)(Tremdo)
-
FMFM44.1kHz16(CD-DA)
-
ROMSound Blaster AWE32EMU800016MIDI32FM ROMRAMCPUCPUMIDI
-
4.5.5 GM-MIDI MIDI()140560MIDI MIDI GM(General MIDI Instrument Map)GM16812810MIDI(MIDI Channel 10)(16) (Sound Effects) MIDIGM
-
4.5.6 MIDI MIDIMIDI(PianoMusic Lesson) MIDIMIDI
-
CakewalkTwelve Tone SystemsMIDICakewalkMIDICakewalk Pro Audio9.06425632bitCakewalk Pro Audio MIDIMIDICakewalk16MIDI(MCI)
-
Cakewalk Pro Audio ()CakewalkMIDI MIDI
-
4.6 4.6.1 207030
-
() TTS(Text-to-Speech)SR(Speech Recognition)TTSSRTTSSR
-
NSI D 4.6.2 -TTS TTS E
-
TTSTTS TTSTTSTTSTTSWAV
-
20602070 TTSTTS
-
TTS TTS TTS
-
TTS ()() TTS
-
TTSTTS TTSTTS TTSTTSEmail
-
4.6.3 TTS (Continuous Speech Recognition)
-
ttwo, true, butter
-
4.6.4 4-29
-
Analysis System 4-29
-
Pattern Training (DTW)(HMM) Pattern Classifier Decision Logic
-
4.6.5 -ViaVoice (Continuous Speech Recognition)
-
IBM1319979IBMViaVoiceIBM301999ViaVoice
-
ViaVoice, ViaVoiceWindows150903200028000ViaVoice ViaVoice
-
4.6.6 4
-
Email 2010
-
21PC,
-
MIDI
-
P100 13 410 1118