SlideShare une entreprise Scribd logo
1  sur  58
Audio Rendering
 & Ambisonics
Audio Rendering
• A single file format contains complete
  (3D?) soundfield data
• At the playback end, the system reproduces
  it to the best of its ability
• Analogous to a Postscript file/printer.
• No 1:1 channel:speaker mapping
• Ambisonics is an example
Ambisonics
• The result of experiments by several
  researchers:
• Professor Fellgett at University of Reading
• Michael Gerzon, Mathematical Institute,
  Oxford
• and others
Michael A Gerzon
Michael A Gerzon
Michael A Gerzon

• 1945–1996
Michael A Gerzon

• 1945–1996
• A true genius, at the level of Blumlein
Michael A Gerzon

• 1945–1996
• A true genius, at the level of Blumlein
• Developed technologies that are still ahead
  of their time:
Michael A Gerzon

• 1945–1996
• A true genius, at the level of Blumlein
• Developed technologies that are still ahead
  of their time:
  • Ambisonics; lossless digital coding; etc
Ambisonics

• Arose out of experiments with four-mic
  tetrahedral arrays
• Led to the development of the Soundfield
  mic
• SFM extends Blumlein into 3D
Ambisonic Advantages




• Apparent movement of sound source
• Ambisonics uses more than just level to provide
  localisation cues – listener position independent
Beyond level-only
          localisation




• Phase-shift panning: localisation by L/R phase
  relationships
Ambisonic Advantages
• In Ambisonics, each location has its own
  combination of level and phase
  relationships.
• Head Related Transfer Functions (HRTF)
  are not considered.
• Decoder is configured to match the
  speaker array in the room – original design
  goal.
Soundfield Microphone
     Principles
• Mid-Side recording
  captures a stereo
  stage (with a good
  sense of depth)
• Omni (L+R) and
  figure-8 (L-R)
Soundfield Microphone
     Principles
• SFM extends this into
  three dimensions
• Omni (sum of all
  directions) “W”
• Three figure-8s at right
  angles “X”, “Y”, “Z”
Soundfield Microphone
    Capsule Array
• Tetrahedral array of
  capsules as close as
  possible
• Circuitry for coincidence
  compensation
• Coincident up to about      Original
  10kHz                        SFM
                              Design
Other SFM Designs


• Tetramic from Core Sound
  …and several others
A-format to B-format



• Capsule signals
  converted to sum &
  difference signals
B-Format:
   The Studio Format
• W = Left + Right + Front + Back
       (+ Up + Down)
• X = Front – Back
• Y = Left – Right
• Z = Up – Down
Halliday/Nimbus
        mic array

• Generates B-Format
  directly
• Omni and two
  figure-8 mics
Transmission

• B-Format thought not suitable for
  transmission as it is not stereo-compatible.
• Is this still a valid problem?
• Could B-Format be carried on DVD? BRD?
Ambisonics
• Two original methods of
  transmission:
Ambisonics
• Two original methods of
  transmission:
 • B-Format (the studio
    format):
    sum & difference channels.
Ambisonics
• Two original methods of
  transmission:
 • B-Format (the studio
    format):
    sum & difference channels.
 • UHJ stereo-compatible
    matrix:
    (typically 2-channel UHJ).
2-channel Transmission
• Matrixing system based on UD-4
• BBC Matrix H, HJ
• UHJ (“Universal HJ”)
• Convert B-Format into a 2-channel format
• Stereo/mono compatible
• Decode at the listening end to suit room
2-Channel Decoder
• Requires the
  listener to have a
  decoder at home
• One more item to
  buy – probably not
  supplied with the
  audio system
Benefits of
Playback-end decoding
• One single source (disc, file etc) the same
  for all applications
• Decoder is configured for the playback
  environment:
  • Number and position of speakers etc
Disadvantages of
Playback-end decoding
• Decoders are needed ‘out there’.
• People have to use them, and set them up
  correctly.
• May be easier with software-based playback
  systems.
The Other Side
       of Ambisonics

• Ambisonics was conceived originally as a
  method of accurately capturing and
  reproducing a natural acoustic event.
The Misconception




• “Ambisonics requires recording with
   a special microphone/array.”
The Misconception

• Almost no commercial music can be picked
  up live with a single microphone
• So what use is Ambisonics?
• Luckily, there are other methods besides a
  special microphone.
Ambisonic Mixing
Ambisonic Mixing
• The vast majority of
  popular music is mixed
  from multitrack.
Ambisonic Mixing
• The vast majority of
  popular music is mixed
  from multitrack.
• Ambisonic panpots predate
  the Soundfield Microphone
Ambisonic Mixing
• The vast majority of
  popular music is mixed
  from multitrack.
• Ambisonic panpots predate
  the Soundfield Microphone
• Ambisonics is particularly
  good at this: for example,
  it’s isotropic.
Ambisonics is
           good at…
• Ambisonics specialises in accurate
  localisation
• Suggests that if you take care of
  localisation, envelopment will take care of
  itself.
• Is this true?
Ambisonic Mixing:
       Principles

• Multitrack environment
• Conventional recording techniques
  (may add an SFM if helpful)
• Ambisonics is used at the Mixing stage
Ambisonic Mixing:
      Principles
• Mono/stereo sources
• B-Format panpots
• B-Format bus
• Record the mix (3- or 4-channel B-Format)
• Monitor the mix (decoder fed by B-format
  bus)
Ambisonic Mixing
        System
• Ambisonic
  Mixing System
  designed to
  allow
  conventional
  consoles to do
  Ambisonics
Ambisonic Mixing System
Ambisonic Mixing Today:
   DAW Support
• DAW needs to have true multichannel
  architecture – not all do!
• Most popular:
  Steinberg Cubase & Nuendo (VST);
  Apple Logic Pro & Soundtrack Pro 2 (AU);
  Audio Mulch & Plogue Bidule (VST)
• Pro Tools is NOT (really) supported
DAW Plug-ins
       for Ambisonics
• Panners, decoders, reverb etc
  implemented as plug-ins
• VST is the most popular
• Audio Units (Apple) also available (B2X)
• First Order Ambisonics recommended
  (higher orders also available)
Some DAW Plug-ins
  for Ambisonics
• Daniel Courville’s B2X suite (Mac only)
• University of York (Mac/Win)
• Gerzonic (Bidule/Audiomulch)
• Bruce Wiggins (Reverb)
• Swiss Centre for Computer Music
  (Max/MSP)
• Visual Virtual Microphone
Some Current Tools

• Daniel
  Courville’s
  B2X
• Apple Audio
  Unit and VST
  plugins
Some Current Tools


• Swiss Centre for
  Computer Music
• VST plugins
Some Current Tools

• University of York
• VST Plugins
• Also higher-order designs
Future Tools?


• Manipulate sounds in
  3D space in a virtual
  world?
Ambisonic Application:
  Large-scale PA
• Funktion One:
  Tony Andrews
• Chemical Brothers,
  Glastonbury Festival
• London’s Millennium
  Dome central show
• Sancho Panza at the
  Glade Festival
Replay & Monitoring
     Observations
• Goal: Wide, accurate listening area
  (or a wide area with a good experience).
• Ideally all speakers are the same.
• Ideally all speakers are full range.
• Speakers should have wide dispersion.
• To a point, more speakers are better
  (decoder must support them).
Degrees of Freedom
• Position virtual sources at any angle around
  the listener (including height)
• Position sounds at a distance with radius
  vector, level and reverb combinations
• Sounds can be stationary or move
• Create a complete synthetic soundfield,
  either like or unlike reality
Artistic Freedom
• Some people feel that direct virtual sources
   should occupy the front stage and only
   ambience behind the listener – NO!
• Place sounds anywhere that you think is
   valid (including the above).
• Mix of a live concert might be like the
   above; in the studio, anything goes.
• If it sounds right, it is right.
Surround Sound offers:
• More freedom to create a sonic
  environment for the listener
• A more immersive experience
• More listener involvement
• Re-creating a real acoustic space/
  performance
• Creating virtual acoustic spaces
Ambisonics offers:
• Better efficiency than 5.1, 7.1, 10.2 etc
• More accurate rendering of source position
• Side and rear images (and height)
• Device-independent rendering: image
  quality is a function of the replay system
• Replay system to suit the environment
If Ambisonics is so
       wonderful…
• Why isn’t everyone using it?
• The old stories…
• Public Domain!
• A lot of people are…
• Free tools and systems
• Some development needed (Pro Tools etc)
Ambisonic Recordings
 www.ambsonia.com
More Resources
at ambisonic.net
Ambisonics Today

• Ambisonics has never been as accessible
• Most tools are free
• You can develop your own
• But what about replay on existing surround
  systems – eg 5.1 home theatre?
Spatial Sound 3: Audio Rendering and Ambisonics

Contenu connexe

Tendances

Tendances (20)

Comp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research DirectionsComp4010 Lecture13 More Research Directions
Comp4010 Lecture13 More Research Directions
 
Introduction of slam
Introduction of slamIntroduction of slam
Introduction of slam
 
Comp4010 2021 Lecture2-Perception
Comp4010 2021 Lecture2-PerceptionComp4010 2021 Lecture2-Perception
Comp4010 2021 Lecture2-Perception
 
Augmented reality
Augmented reality Augmented reality
Augmented reality
 
Comp4010 Lecture4 AR Tracking and Interaction
Comp4010 Lecture4 AR Tracking and InteractionComp4010 Lecture4 AR Tracking and Interaction
Comp4010 Lecture4 AR Tracking and Interaction
 
Lecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented RealityLecture 8 Introduction to Augmented Reality
Lecture 8 Introduction to Augmented Reality
 
Comp4010 Lecture10 VR Interface Design
Comp4010 Lecture10 VR Interface DesignComp4010 Lecture10 VR Interface Design
Comp4010 Lecture10 VR Interface Design
 
Grand Challenges for Mixed Reality
Grand Challenges for Mixed Reality Grand Challenges for Mixed Reality
Grand Challenges for Mixed Reality
 
The game of go
The game of goThe game of go
The game of go
 
COMP 4010 Lecture5 VR Audio and Tracking
COMP 4010 Lecture5 VR Audio and TrackingCOMP 4010 Lecture5 VR Audio and Tracking
COMP 4010 Lecture5 VR Audio and Tracking
 
HoloLens Introduction and Technical Specifications
HoloLens Introduction and Technical SpecificationsHoloLens Introduction and Technical Specifications
HoloLens Introduction and Technical Specifications
 
EYE TRACKING TECHNOLOGY
EYE TRACKING TECHNOLOGYEYE TRACKING TECHNOLOGY
EYE TRACKING TECHNOLOGY
 
COMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented RealityCOMP 4010 - Lecture 7: Introduction to Augmented Reality
COMP 4010 - Lecture 7: Introduction to Augmented Reality
 
Future Directions for Compute-for-Graphics
Future Directions for Compute-for-GraphicsFuture Directions for Compute-for-Graphics
Future Directions for Compute-for-Graphics
 
Lecture7 Example VR Applications
Lecture7 Example VR ApplicationsLecture7 Example VR Applications
Lecture7 Example VR Applications
 
COMP 4010: Lecture2 VR Technology
COMP 4010: Lecture2 VR TechnologyCOMP 4010: Lecture2 VR Technology
COMP 4010: Lecture2 VR Technology
 
Novel Interfaces for AR Systems
Novel Interfaces for AR SystemsNovel Interfaces for AR Systems
Novel Interfaces for AR Systems
 
fusion of Camera and lidar for autonomous driving II
fusion of Camera and lidar for autonomous driving IIfusion of Camera and lidar for autonomous driving II
fusion of Camera and lidar for autonomous driving II
 
도우진&김영수, 게임잼 운영과 게이미피케이션, NDC2012
도우진&김영수, 게임잼 운영과 게이미피케이션, NDC2012도우진&김영수, 게임잼 운영과 게이미피케이션, NDC2012
도우진&김영수, 게임잼 운영과 게이미피케이션, NDC2012
 
Augmented Reality
Augmented Reality Augmented Reality
Augmented Reality
 

En vedette

UCSD_SRC Presentation
UCSD_SRC PresentationUCSD_SRC Presentation
UCSD_SRC Presentation
Melisa Tallis
 
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Robert Ballon
 
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
奈良先端大 情報科学研究科
 
Life Beautiful Monday
Life Beautiful MondayLife Beautiful Monday
Life Beautiful Monday
Pentiux
 
Portland Front Yard Gardens
Portland Front Yard GardensPortland Front Yard Gardens
Portland Front Yard Gardens
gardenmam
 
Ocelot Project, OW2con11, Nov 24-25, Paris
Ocelot Project, OW2con11, Nov 24-25, ParisOcelot Project, OW2con11, Nov 24-25, Paris
Ocelot Project, OW2con11, Nov 24-25, Paris
OW2
 
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OW2
 
Free Cloud Alliance OW2 Conference Nov10
Free Cloud Alliance OW2 Conference Nov10Free Cloud Alliance OW2 Conference Nov10
Free Cloud Alliance OW2 Conference Nov10
OW2
 

En vedette (20)

Spatial Sound parts 1 & 2
Spatial Sound parts 1 & 2Spatial Sound parts 1 & 2
Spatial Sound parts 1 & 2
 
Ambisonics: Getting the Best Surround Around
Ambisonics: Getting the Best Surround AroundAmbisonics: Getting the Best Surround Around
Ambisonics: Getting the Best Surround Around
 
3 D Sound
3 D Sound3 D Sound
3 D Sound
 
UCSD_SRC Presentation
UCSD_SRC PresentationUCSD_SRC Presentation
UCSD_SRC Presentation
 
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
Bachelorthesis Robert Ballon Intelligentes Mikrofonsystem - Einsatzszenarien ...
 
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...Robust Sound Field Reproduction against  Listener’s Movement Utilizing Image ...
Robust Sound Field Reproduction against Listener’s Movement Utilizing Image ...
 
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」 SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」
SIG-Audio#13 GDC2016オーディオ報告会「出展ブースからみるGDC」
 
Speech recognition
Speech recognitionSpeech recognition
Speech recognition
 
Life Beautiful Monday
Life Beautiful MondayLife Beautiful Monday
Life Beautiful Monday
 
Tech talk: PHP
Tech talk: PHPTech talk: PHP
Tech talk: PHP
 
9000420886
90004208869000420886
9000420886
 
ETICS- quality certification of open source cloud software, OW2con'12, Paris
ETICS- quality certification of open source cloud software, OW2con'12, ParisETICS- quality certification of open source cloud software, OW2con'12, Paris
ETICS- quality certification of open source cloud software, OW2con'12, Paris
 
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...
CHOReOS: "Large Scale Choreographies for the Future Internet", from theory to...
 
Portland Front Yard Gardens
Portland Front Yard GardensPortland Front Yard Gardens
Portland Front Yard Gardens
 
Ayora 2010
Ayora 2010Ayora 2010
Ayora 2010
 
Star Animation I
Star Animation IStar Animation I
Star Animation I
 
Ocelot Project, OW2con11, Nov 24-25, Paris
Ocelot Project, OW2con11, Nov 24-25, ParisOcelot Project, OW2con11, Nov 24-25, Paris
Ocelot Project, OW2con11, Nov 24-25, Paris
 
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
OCCIware project and OCCI standard presented at China Cloud Computing & Stand...
 
Cloud workload guidelines
Cloud workload guidelinesCloud workload guidelines
Cloud workload guidelines
 
Free Cloud Alliance OW2 Conference Nov10
Free Cloud Alliance OW2 Conference Nov10Free Cloud Alliance OW2 Conference Nov10
Free Cloud Alliance OW2 Conference Nov10
 

Similaire à Spatial Sound 3: Audio Rendering and Ambisonics

Audio production
Audio productionAudio production
Audio production
Jack-Tanner
 

Similaire à Spatial Sound 3: Audio Rendering and Ambisonics (20)

Future Proof Surround Sound Mixing using Ambisonics
Future Proof Surround Sound Mixing using AmbisonicsFuture Proof Surround Sound Mixing using Ambisonics
Future Proof Surround Sound Mixing using Ambisonics
 
Audios in Unity
Audios in UnityAudios in Unity
Audios in Unity
 
Location Audio
Location AudioLocation Audio
Location Audio
 
Tutorial for Wavepad
Tutorial for WavepadTutorial for Wavepad
Tutorial for Wavepad
 
Surround Sound
Surround SoundSurround Sound
Surround Sound
 
Music production
Music productionMusic production
Music production
 
Surround sount system
Surround sount systemSurround sount system
Surround sount system
 
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4Build Your Own VR Display Course - SIGGRAPH 2017: Part 4
Build Your Own VR Display Course - SIGGRAPH 2017: Part 4
 
Audio production
Audio productionAudio production
Audio production
 
Audio production
Audio productionAudio production
Audio production
 
Confrontation Audio GDC 2009
Confrontation Audio GDC 2009Confrontation Audio GDC 2009
Confrontation Audio GDC 2009
 
Multitrack Workflow for Cinema/Video
Multitrack Workflow for Cinema/VideoMultitrack Workflow for Cinema/Video
Multitrack Workflow for Cinema/Video
 
WebRTC, RED and Janus @ ClueCon21
WebRTC, RED and Janus @ ClueCon21WebRTC, RED and Janus @ ClueCon21
WebRTC, RED and Janus @ ClueCon21
 
Chapter Seven
Chapter SevenChapter Seven
Chapter Seven
 
Interactive Voice Con
Interactive Voice ConInteractive Voice Con
Interactive Voice Con
 
Digital audio
Digital audioDigital audio
Digital audio
 
Digital audio
Digital audioDigital audio
Digital audio
 
05 audio
05 audio05 audio
05 audio
 
audio-production-1231352387673755-2.ppt
audio-production-1231352387673755-2.pptaudio-production-1231352387673755-2.ppt
audio-production-1231352387673755-2.ppt
 
JBL Synthesis & Thasmai
JBL Synthesis & ThasmaiJBL Synthesis & Thasmai
JBL Synthesis & Thasmai
 

Dernier

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Dernier (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Advantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your BusinessAdvantages of Hiring UIUX Design Service Providers for Your Business
Advantages of Hiring UIUX Design Service Providers for Your Business
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 

Spatial Sound 3: Audio Rendering and Ambisonics

  • 1. Audio Rendering & Ambisonics
  • 2. Audio Rendering • A single file format contains complete (3D?) soundfield data • At the playback end, the system reproduces it to the best of its ability • Analogous to a Postscript file/printer. • No 1:1 channel:speaker mapping • Ambisonics is an example
  • 3. Ambisonics • The result of experiments by several researchers: • Professor Fellgett at University of Reading • Michael Gerzon, Mathematical Institute, Oxford • and others
  • 6. Michael A Gerzon • 1945–1996
  • 7. Michael A Gerzon • 1945–1996 • A true genius, at the level of Blumlein
  • 8. Michael A Gerzon • 1945–1996 • A true genius, at the level of Blumlein • Developed technologies that are still ahead of their time:
  • 9. Michael A Gerzon • 1945–1996 • A true genius, at the level of Blumlein • Developed technologies that are still ahead of their time: • Ambisonics; lossless digital coding; etc
  • 10. Ambisonics • Arose out of experiments with four-mic tetrahedral arrays • Led to the development of the Soundfield mic • SFM extends Blumlein into 3D
  • 11. Ambisonic Advantages • Apparent movement of sound source • Ambisonics uses more than just level to provide localisation cues – listener position independent
  • 12. Beyond level-only localisation • Phase-shift panning: localisation by L/R phase relationships
  • 13. Ambisonic Advantages • In Ambisonics, each location has its own combination of level and phase relationships. • Head Related Transfer Functions (HRTF) are not considered. • Decoder is configured to match the speaker array in the room – original design goal.
  • 14. Soundfield Microphone Principles • Mid-Side recording captures a stereo stage (with a good sense of depth) • Omni (L+R) and figure-8 (L-R)
  • 15. Soundfield Microphone Principles • SFM extends this into three dimensions • Omni (sum of all directions) “W” • Three figure-8s at right angles “X”, “Y”, “Z”
  • 16. Soundfield Microphone Capsule Array • Tetrahedral array of capsules as close as possible • Circuitry for coincidence compensation • Coincident up to about Original 10kHz SFM Design
  • 17. Other SFM Designs • Tetramic from Core Sound …and several others
  • 18. A-format to B-format • Capsule signals converted to sum & difference signals
  • 19. B-Format: The Studio Format • W = Left + Right + Front + Back (+ Up + Down) • X = Front – Back • Y = Left – Right • Z = Up – Down
  • 20. Halliday/Nimbus mic array • Generates B-Format directly • Omni and two figure-8 mics
  • 21. Transmission • B-Format thought not suitable for transmission as it is not stereo-compatible. • Is this still a valid problem? • Could B-Format be carried on DVD? BRD?
  • 22. Ambisonics • Two original methods of transmission:
  • 23. Ambisonics • Two original methods of transmission: • B-Format (the studio format): sum & difference channels.
  • 24. Ambisonics • Two original methods of transmission: • B-Format (the studio format): sum & difference channels. • UHJ stereo-compatible matrix: (typically 2-channel UHJ).
  • 25. 2-channel Transmission • Matrixing system based on UD-4 • BBC Matrix H, HJ • UHJ (“Universal HJ”) • Convert B-Format into a 2-channel format • Stereo/mono compatible • Decode at the listening end to suit room
  • 26. 2-Channel Decoder • Requires the listener to have a decoder at home • One more item to buy – probably not supplied with the audio system
  • 27. Benefits of Playback-end decoding • One single source (disc, file etc) the same for all applications • Decoder is configured for the playback environment: • Number and position of speakers etc
  • 28. Disadvantages of Playback-end decoding • Decoders are needed ‘out there’. • People have to use them, and set them up correctly. • May be easier with software-based playback systems.
  • 29. The Other Side of Ambisonics • Ambisonics was conceived originally as a method of accurately capturing and reproducing a natural acoustic event.
  • 30. The Misconception • “Ambisonics requires recording with a special microphone/array.”
  • 31. The Misconception • Almost no commercial music can be picked up live with a single microphone • So what use is Ambisonics? • Luckily, there are other methods besides a special microphone.
  • 33. Ambisonic Mixing • The vast majority of popular music is mixed from multitrack.
  • 34. Ambisonic Mixing • The vast majority of popular music is mixed from multitrack. • Ambisonic panpots predate the Soundfield Microphone
  • 35. Ambisonic Mixing • The vast majority of popular music is mixed from multitrack. • Ambisonic panpots predate the Soundfield Microphone • Ambisonics is particularly good at this: for example, it’s isotropic.
  • 36. Ambisonics is good at… • Ambisonics specialises in accurate localisation • Suggests that if you take care of localisation, envelopment will take care of itself. • Is this true?
  • 37. Ambisonic Mixing: Principles • Multitrack environment • Conventional recording techniques (may add an SFM if helpful) • Ambisonics is used at the Mixing stage
  • 38. Ambisonic Mixing: Principles • Mono/stereo sources • B-Format panpots • B-Format bus • Record the mix (3- or 4-channel B-Format) • Monitor the mix (decoder fed by B-format bus)
  • 39. Ambisonic Mixing System • Ambisonic Mixing System designed to allow conventional consoles to do Ambisonics
  • 41. Ambisonic Mixing Today: DAW Support • DAW needs to have true multichannel architecture – not all do! • Most popular: Steinberg Cubase & Nuendo (VST); Apple Logic Pro & Soundtrack Pro 2 (AU); Audio Mulch & Plogue Bidule (VST) • Pro Tools is NOT (really) supported
  • 42. DAW Plug-ins for Ambisonics • Panners, decoders, reverb etc implemented as plug-ins • VST is the most popular • Audio Units (Apple) also available (B2X) • First Order Ambisonics recommended (higher orders also available)
  • 43. Some DAW Plug-ins for Ambisonics • Daniel Courville’s B2X suite (Mac only) • University of York (Mac/Win) • Gerzonic (Bidule/Audiomulch) • Bruce Wiggins (Reverb) • Swiss Centre for Computer Music (Max/MSP) • Visual Virtual Microphone
  • 44. Some Current Tools • Daniel Courville’s B2X • Apple Audio Unit and VST plugins
  • 45. Some Current Tools • Swiss Centre for Computer Music • VST plugins
  • 46. Some Current Tools • University of York • VST Plugins • Also higher-order designs
  • 47. Future Tools? • Manipulate sounds in 3D space in a virtual world?
  • 48. Ambisonic Application: Large-scale PA • Funktion One: Tony Andrews • Chemical Brothers, Glastonbury Festival • London’s Millennium Dome central show • Sancho Panza at the Glade Festival
  • 49. Replay & Monitoring Observations • Goal: Wide, accurate listening area (or a wide area with a good experience). • Ideally all speakers are the same. • Ideally all speakers are full range. • Speakers should have wide dispersion. • To a point, more speakers are better (decoder must support them).
  • 50. Degrees of Freedom • Position virtual sources at any angle around the listener (including height) • Position sounds at a distance with radius vector, level and reverb combinations • Sounds can be stationary or move • Create a complete synthetic soundfield, either like or unlike reality
  • 51. Artistic Freedom • Some people feel that direct virtual sources should occupy the front stage and only ambience behind the listener – NO! • Place sounds anywhere that you think is valid (including the above). • Mix of a live concert might be like the above; in the studio, anything goes. • If it sounds right, it is right.
  • 52. Surround Sound offers: • More freedom to create a sonic environment for the listener • A more immersive experience • More listener involvement • Re-creating a real acoustic space/ performance • Creating virtual acoustic spaces
  • 53. Ambisonics offers: • Better efficiency than 5.1, 7.1, 10.2 etc • More accurate rendering of source position • Side and rear images (and height) • Device-independent rendering: image quality is a function of the replay system • Replay system to suit the environment
  • 54. If Ambisonics is so wonderful… • Why isn’t everyone using it? • The old stories… • Public Domain! • A lot of people are… • Free tools and systems • Some development needed (Pro Tools etc)
  • 57. Ambisonics Today • Ambisonics has never been as accessible • Most tools are free • You can develop your own • But what about replay on existing surround systems – eg 5.1 home theatre?

Notes de l'éditeur

  1. \n
  2. \n
  3. \n
  4. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  5. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  6. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  7. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  8. Mouse click to add each new point on a slide, as well as advancing slides. First click here brings up Gerzon pic; click immediately again to bring up 1st point. Then, 3 points skipping over Ambisonic principles. Go as fast as possible.\n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. Contrasts B-Format and UHJ. Three points (one main which comes up with slide). Go through as far as possible.\n
  22. Contrasts B-Format and UHJ. Three points (one main which comes up with slide). Go through as far as possible.\n
  23. Contrasts B-Format and UHJ. Three points (one main which comes up with slide). Go through as far as possible.\n
  24. \n
  25. \n
  26. \n
  27. \n
  28. \n
  29. Conventional mic-based view of Ambisonics. Just the one point, on long enough to say it. Slide comes up complete.\n
  30. \n
  31. “Why is Ambisonic Mixing important?” Say this and then click to bring up point 1: Because most music is done that way. Isotropic = gives equal precedent from sounds coming from all directions - important for artificial soundfields. ‘AMG’ is us of course. 3 points. An old picture of RE.\n
  32. “Why is Ambisonic Mixing important?” Say this and then click to bring up point 1: Because most music is done that way. Isotropic = gives equal precedent from sounds coming from all directions - important for artificial soundfields. ‘AMG’ is us of course. 3 points. An old picture of RE.\n
  33. “Why is Ambisonic Mixing important?” Say this and then click to bring up point 1: Because most music is done that way. Isotropic = gives equal precedent from sounds coming from all directions - important for artificial soundfields. ‘AMG’ is us of course. 3 points. An old picture of RE.\n
  34. \n
  35. \n
  36. \n
  37. \n
  38. \n
  39. \n
  40. \n
  41. \n
  42. \n
  43. \n
  44. \n
  45. \n
  46. \n
  47. \n
  48. \n
  49. \n
  50. \n
  51. \n
  52. \n
  53. \n
  54. \n
  55. \n
  56. \n