Overview
Guest lecture on how music data travels over IP networks, featuring Yamaha's Disklavier technology as a case study.
1. Yamaha Corporation History
Company Foundation
- Founded: October 12, 1887
- Original Name: Nippon Gakki
- Founder: Torakusu Yamaha
- Originally a watchmaker (precision was important to him)
- Fixed broken organs in Hamamatsu
- Had passion for music
Key Milestones
- 1898: First use of Tuning Fork Mark
- 1954: Opened first music class
- 1956: Changed name from Yamaha Organ School to Yamaha Music School
- 1965: Opened Yamaha Music School USA (first country outside Japan)
- 1966: Operated in Thailand for first time by Dr. Thaworn Phornprapha (Siam Kolkarn musical school)
Current Scale
- 5,000 locations worldwide
- Operating in 40+ countries
- 5.5 million alumni
- Market cap: $3.08 billion USD (as of October 2024)
- 24% market share in musical instruments globally
2. Yamaha Logo & Brand Identity
Three Tuning Forks Symbolism
Music Elements
- Melody
- Harmony
- Rhythm
Business Elements
- Technology
- Production
- Sales
Two Yamaha Brands
- Purple Logo (2D): Yamaha Corporation - Musical Instruments
- Red Logo (3D): Yamaha Motors - Motorcycles
- Created during WWII for Japanese military
- After Japan lost WWII, President Kenji Kawakami established music schools to make children happy
3. Sound Fundamentals
What is Sound?
- Definition: Vibration that travels through a medium (air, water, solid)
- Type: Mechanical wave (needs a medium, unlike light)
- Examples: Speaking, clapping, playing instruments
Properties of Sound Waves
- Frequency (Hz): Determines pitch
- Amplitude: Determines loudness
- Wavelength: Distance between wave peaks
- Speed: Depends on medium (faster in solids, slower in gases)
4. Piano Sound Production Mechanism
Components Required
- Keys
- Hammers (70+ different components per key)
- Strings
- Bridges
- Soundboard (acts like a speaker)
- Piano Lid (controls sound direction)
How It Works
- Key is pressed
- Hammer strikes strings from below
- String vibrations transmitted to soundboard through bridges
- Soundboard vibrates and amplifies sound
- Entire piano resonates to produce sound
5. MIDI (Musical Instrument Digital Interface)
Definition
- Communication protocol between instruments and computers
- NOT sound itself, but digital messages/instructions
- Standard since 1983, still used today
Key Characteristics
- Serial transmission at 31.25 kbps
- One cable supports 16 channels
- Messages include: note on, note off, velocity
MIDI Message Structure
Status Byte | Data Byte | Data Byte
[Note ON] [MIDI CH] [Note Number] [Velocity]
- 8-bit binary number: 256 possible values (0-255)
- First bit = 1: Status byte
- First bit = 0: Data byte
- Only 7 bits available for data = 128 different values (0-127)
Digital Performer MIDI Signal Flow
MIDI Track → Instrument Track (NanoSampler) → Audio Track → Master Fader → Speaker
6. MIDI vs Real Instruments
Advantages of MIDI
- Store data digitally
- Playback on different instruments
- Easy editing and manipulation
- Very small file size (<1 MB vs 60+ MB for audio)
Limitations of MIDI
- Cannot capture articulation (expression details)
- Limited to 127 velocity levels
- Real pianists can express more than 127 levels of dynamics
- Sounds "perfect" but lacks human feel
- Out-of-pitch makes music more beautiful and natural - AI cannot replicate this
7. Network Fundamentals
IP (Internet Protocol)
- Rules for addressing and routing data across networks
- Provides addressing and delivery
- Enables global device connectivity
IP Address Types
Public IP Address
- Unique identifier assigned by ISP
- Visible to everyone on internet
- Primary means of identifying devices online
Static IP Address
- Remains constant over time
- Like a permanent home address
- Manually assigned or configured
Dynamic IP Address
- Changes periodically
- Assigned by DHCP server
- Typically for limited time
Why IP Addresses Are Important
- Universal standard for identifying devices
- Breaks data into "packets"
- Routes packets across networks to correct destinations
- Without IP, internet would be chaotic and disconnected
8. IP Routing
Concept
- Routers forward packets across networks
- Default gateway = router address
- Routing tables determine next hop
Example: Online Shopping
- Order sent to China
- Seller confirms order
- Package goes to airport
- Flies to Bangkok
- Goes to delivery service
- Arrives at your home
9. Network Protocols with IP
Three Main Protocols
- TCP/IP (Transmission Control Protocol)
- Reliable, ordered delivery
- UDP/IP (User Datagram Protocol)
- Faster, no guarantee of delivery
- ICMP (ping, traceroute)
- Network diagnostics
10. IP Security
Threats
- Spoofing
- Sniffing
- DDoS attacks
Solutions
- IPsec (IP Security)
- VPNs (Virtual Private Networks)
- Firewalls
- Ensures secure communication
IPsec Tunnel Mode
Original: [IP Header][TCP Header][Data]
Encrypted: [New IP Header][ESP Header][IP Header][TCP Header][Data][ESP Trailer][ESP Auth]
VPN Usage
- Encrypts data transmission
- Creates secure tunnel
- Common uses: Accessing restricted content, privacy
11. MIDI Connection and VST Instruments
Setup Components
- Computer running MIDI Sequencer
- USB MIDI Interface
- MIDI Thru Box (splits signal to multiple devices)
- MIDI Controller (keyboard)
- Multiple synthesizer/sound modules
VST (Virtual Studio Technology)
- DAW (Digital Audio Workstation) triggers VST instruments
- Software synthesizers without physical hardware
- Allows playing multiple virtual instruments from one controller
12. MIDI vs Network Diagram Comparison
Similarities
- Both show data flow and connections
- MIDI connects instruments to computers
- Networks connect devices to internet
- Both use routing concepts
13. Yamaha Disklavier Technology
Definition
Acoustic piano with integrated digital system that:
- Records piano performances using optical sensors
- Reproduces performances using electromechanical solenoids
- Moves keys, hammers, and pedals automatically
Features
- Built-in tone generator
- Speakers
- MIDI connectivity
- Playback of thousands of songs
- Records human performances with extreme precision
- Captures every nuance of live performance
14. Disklavier Technologies and Concepts
1. Optical Sensor System
- World's first continuous-detection optical hammer sensor
- Meticulously captures every nuance of piano performance
2. Servo Control System
- Uses optical sensors to monitor and verify key, hammer, and pedal movement in real-time
- Ensures accurate and precise performance reproduction
3. Data Measurement
- Academic research at Yamaha's Minalab
- Utilizes Disklavier ENSPIRE PRO pianos
- Measures intricate instrument movements
- Gains data directly from sensors
4. Telematic Music Performance
- Enables network music performances
- Allows distance learning
- Real-time interactions between performers and audiences across countries and campuses
5. Performance Reproduction and Analysis
- Studies investigate reliability of Disklavier systems
- Compares recording and reproduction precision with professional pianists
15. Disklavier for Education
Built for Students
- Empowers music education
- Visual masterclasses
- Piano performance analytics
- Distance learning
Educational Applications
Remote Masterclass
- Music institutions can host masterclasses from professors around the globe
- No need for international travel
- Reduced costs
Playback Meets Precision
- Only reproducing piano with fully-integrated record and playback system
On-Demand Accompaniment
- Students can play melody
- System provides harmony/background music
- Accompanist performs remotely
Artistic Versatility
- Center stage performances
- World-renowned artist concerts
- Redefines performance expectations
Distance Learning
- Removes geographic boundaries
- Makes music education more accessible
Remote Auditions
- Students can audition anywhere in the world
- Especially important during COVID-19
16. Remote Learning Activities (During COVID-19)
Key Applications
- Recruiting
- Distance Learning
- Remote Master Classes
- Virtual Performances
- Collaborative Piano
- Supplemental Income
Impact
- Over 20 years of Remote Lesson technology
- Staple in world-class music schools globally
- Best way to continue high-quality piano study during and after COVID-19 pandemic
17. How MIDI Data Transmits via Internet
Data Flow Process
Kinetic Movement → MIDI → Data Encryption → Sent to YCJ/DKV Server →
Send to Destination → Data Decryption → MIDI → Kinetic Movement
Key Points
- User sees simple "call Disklavier to Disklavier" interface
- Behind scenes: VPN tunnels created through Yamaha servers
- Data encrypted for security
- Actual data transmitted through Yamaha Corporation servers (not direct connection)
Technical Details
- Player creates kinetic movement
- Optical sensors detect hammer/key/pedal movement
- Converts kinetic movement to MIDI messages
- Data encryption for safety
- Sent to YCJS (Yamaha Corporation Japan Server)
- Forwarded to destination
- Data decryption at destination
- Converts MIDI back to kinetic movement
- Solenoids move keys/hammers/pedals
18. Remote Learning Network Diagram
Host Center Setup
- Computer
- Mixer (AG-6)
- Microphone
- Speaker
- Webcam
- Video switcher (optional)
- Tablet (for Disklavier control)
- Disklavier Piano
- Internet Switch
- Connected to Internet
Remote Center Setup
- Same equipment as Host Center
- Mirror configuration
- Real-time audio through Disklavier (not Zoom)
- Video through Zoom/Google Meet
Why Not Just Use Zoom?
- Pianists are very focused on acoustic sounds
- Even with good speakers, acoustic quality is lost
- Acoustic impact is very important for pianists
- Music data transmission preserves natural piano sound
19. Multiple Disklavier Connections
Current Capability
- Up to 4 Disklaviers can connect to one host simultaneously
- All through Yamaha's cloud server infrastructure
Future Potential
- Live concerts from famous artists (e.g., Alicia Keys)
- Broadcast directly to homes
- Creates unforgettable memory
- Experiencing performance from home with full acoustic quality
20. MIDI File Size Comparison
Sound File
- Often 60+ MB
- Contains actual audio data
MIDI File
- Less than 1 MB
- Contains only instructions/messages
- Much more efficient for transmission over internet
21. Key Differences: Transfer Sound Data vs Real Sound
Transfer Sound Data (MIDI)
- Digital messages
- Small file size
- Can be edited
- Lacks full expression
- Limited to 127 velocity levels
Real Sound
- Analog/acoustic
- Captures full expression
- Natural imperfections
- Cannot be easily edited
- Unlimited dynamic range
22. Three Core Questions Answered
1. Why transmit music data over internet?
- Enable remote performances
- Distance learning
- Reduce costs (no travel needed)
- Accessibility
- Especially critical during COVID-19
2. How does music data travel over IP network?
- Converted to MIDI messages
- Encrypted
- Sent through Yamaha servers via VPN tunnels
- Decrypted at destination
- Converted back to kinetic movement
3. What's the difference between transfer sound data and real sound?
- MIDI = instructions (small, editable, limited expression)
- Real sound = acoustic performance (full expression, natural, larger file)
- Disklavier combines both: transmits MIDI but produces real acoustic sound
Key Takeaways
- Music and technology blend as one - engineering background valuable in music business
- Acoustic quality cannot be compromised for classical musicians
- MIDI is instructions, not sound - but Disklavier produces real acoustic output
- Human imperfection makes music beautiful - AI cannot fully replicate
- Network technology enables global music education and performances
- Small MIDI files (<1MB) enable efficient transmission over internet
- VPN and encryption ensure secure music data transmission
- Optical sensors capture every nuance of piano performance
- Disklavier solved remote music education during COVID-19
- Technology should serve musicians, not replace them
Important Concepts to Remember
- Yamaha's three tuning forks: Music (Melody, Harmony, Rhythm) + Business (Technology, Production, Sales)
- MIDI limitations: Only 7 bits for data = 127 levels
- IP routing: Like package delivery system
- Acoustic vs Digital: Disklavier bridges both worlds
- Remote learning: Requires both video (Zoom) and audio (Disklavier) systems
- Up to 4 Disklaviers can connect to one host
- Data encryption/decryption for security
- Yamaha servers handle all connections (not peer-to-peer)