This patent describes a system designed to evaluate singing performance. The system includes components for receiving singing audio samples, such as a reference track or a user's performance, as well as representations of their pitch contours. A processor unit is connected to these components and contains several modules: one for extracting pitch contour representations (PCRs), another for synchronizing the timing of PCRs between the reference and user audio, a selection module to isolate specific segments for comparison, a cross-correlation module to analyze the similarity of selected segments, and modules for assessing key and rhythm matching. These modules generate scores based on predefined criteria, which are then combined to produce an overall singing score. The system also features a user interface for adjusting module parameters and includes storage and display capabilities for PCR visualization and score presentation.
The invention addresses the limitations of existing methods for scoring singing voice, particularly those reliant on pre-stored written symbolic scores. These methods often overlook crucial musical components such as inter and intra-note pitch transitions, leading to coarse evaluations that lack accuracy. Additionally, the reliance on written scores necessitates manual input and restricts the scope of comparison parameters, hindering comprehensive assessments of singing performance.
- Extraction and storage of inter and intra-note pitch variations: The device captures detailed pitch contours from both reference and user singing voices, enabling a thorough analysis of pitch transitions crucial for evaluating singing quality.
- Dynamic time warping (DTW) for comparison: By employing DTW, the device aligns and compares continuous melodic contours, accommodating variations in timing and shape to accurately assess similarity between reference and user performances.
- Key-matching and normalization units: These units ensure alignment of pitch and timing dimensions between reference and user melodic contours, enhancing the accuracy of comparison and scoring.
- User-friendly interface: The device incorporates visual and auditory feedback mechanisms, facilitating user interaction and enabling effective learning and improvement of singing skills.
- Superior scoring strategy: The combination of detailed pitch analysis and dynamic comparison techniques results in a scoring method that aligns closely with the judgment of trained musicians, ensuring reliable evaluations of singing performance.
The patent describes a comprehensive system comprising digital music processors, monophonic instrument processors, scorers, synthesizers, and user interface components. These components work together to extract, analyze, compare, and score singing performances based on detailed pitch contours.
The patent was licensed to SensiBol who have been exploiting it commercially.
9
- Facilitates learning and skill improvement: By providing detailed feedback and guidance, the technology empowers singers to enhance their musical abilities, contributing to personal development and artistic expression.
- Enhances entertainment experiences: Improved scoring accuracy in karaoke systems enhances user enjoyment and satisfaction, fostering a more engaging and immersive entertainment experience.
- Supports fair competition and assessment: Objective scoring methods enable fair and consistent evaluation of singing performances in competitions and auditions, promoting transparency and meritocracy in the music industry.
- Music Education: Institutions offering music lessons, workshops, and educational programs.
- Entertainment and Karaoke Systems: Companies developing and providing karaoke machines, applications, and services.
- Music Production: Recording studios, music producers, and audio engineers involved in recording and producing music. Performance Assessment: Event organizers, talent agencies, and organizations conducting competitions, auditions, and performances.
- Music education: Provides valuable feedback to singers and instrumentalists for improving their skills.
- Karaoke systems: Enhances the user experience by providing more accurate scoring and feedback.
- Music production: Facilitates the evaluation of vocal performances during recording sessions.
- Performance assessment: Enables objective evaluation of singing quality in competitions and auditions.
1338/MUM/2009
414796