Latest in cs.sd
total 726took 0.23s
Deep Predictive Models in Interactive MusicJan 31 2018Automatic music generation is a compelling task where much recent progress has been made with deep learning models. In this paper, we ask how these models can be integrated into interactive music systems; how can they encourage or enhance the music making ... More Highly-Reverberant Real Environment database: HRREJan 29 2018Speech recognition in highly-reverberant real environments remains a major challenge. An evaluation dataset for this task is needed. This report describes the generation of the Highly-Reverberant Real Environment database (HRRE). This database contains ... More Wavenet based low rate speech codingDec 01 2017Traditional parametric coding of speech facilitates low rate but provides poor reconstruction quality because of the inadequacy of the model used. We describe how a WaveNet generative speech model can be used to generate high quality speech from the bit ... More HoME: a Household Multimodal EnvironmentNov 29 2017We introduce HoME: a Household Multimodal Environment for artificial agents to learn from vision, audio, semantics, physics, and interaction with objects and other agents, all within a realistic context. HoME integrates over 45,000 diverse 3D house layouts ... More Onsets and Frames: Dual-Objective Piano TranscriptionOct 30 2017We consider the problem of transcribing polyphonic piano music with an emphasis on generalizing to unseen instruments. We use deep neural networks and propose a novel approach that predicts onsets and frames using both CNNs and LSTMs. This model predicts ... More Linear Computer-Music through Sequences over Galois FieldsSep 19 2017It is shown how binary sequences can be associated with automatic composition of monophonic pieces. We are concerned with the composition of e-music from finite field structures. The information at the input may be either random or information from a ... More Object-Based Audio RenderingAug 23 2017Apparatus and methods are disclosed for performing object-based audio rendering on a plurality of audio objects which define a sound scene, each audio object comprising at least one audio signal and associated metadata. The apparatus comprises: a plurality ... More Classical Music Composition Using State Space ModelsAug 12 2017Algorithmic composition of music has a long history and with the development of powerful deep learning methods, there has recently been increased interest in exploring algorithms and models to create art. We explore the utility of state space models, ... More Understanding MIDI: A Painless Tutorial on Midi FormatMay 15 2017A short overview demystifying the midi audio format is presented. The goal is to explain the file structure and how the instructions are used to produce a music signal, both in the case of monophonic signals as for polyphonic signals. A Comparison of deep learning methods for environmental soundMar 20 2017Environmental sound detection is a challenging application of machine learning because of the noisy nature of the signal, and the small amount of (labeled) data that is typically available. This work thus presents a comparison of several state-of-the-art ... More FMA: A Dataset For Music AnalysisDec 06 2016We present a new music dataset that can be used for several music analysis tasks. Our major goal is to go beyond the existing limitations of available music datasets, which are either the small size of datasets with raw audio tracks, the availability ... More Algorithmic Songwriting with ALYSIADec 04 2016This paper introduces ALYSIA: Automated LYrical SongwrIting Application. ALYSIA is based on a machine learning model using Random Forests, and we discuss its success at pitch and rhythm prediction. Next, we show how ALYSIA was used to create original ... More DeepBach: a Steerable Model for Bach chorales generationDec 03 2016The composition of polyphonic chorale music in the style of J.S Bach has represented a major challenge in automatic music composition over the last decades. The art of Bach chorales composition involves combining four-part harmony with characteristic ... More FRIDA: FRI-Based DOA Estimation for Arbitrary Array LayoutsDec 02 2016In this paper we present FRIDA---an algorithm for estimating directions of arrival of multiple wideband sound sources. FRIDA combines multi-band information coherently and achieves state-of-the-art resolution at extremely low signal-to-noise ratios. It ... More Learning Features of Music from ScratchNov 29 2016We introduce a new large-scale music dataset, MusicNet, to serve as a source of supervision and evaluation of machine learning methods for music research. MusicNet consists of hundreds of freely-licensed classical music recordings by 10 composers, written ... More Learning Filter Banks Using Deep Learning For Acoustic SignalsNov 29 2016Designing appropriate features for acoustic event recognition tasks is an active field of research. Expressive features should both improve the performance of the tasks and also be interpret-able. Currently, heuristically designed features based on the ... More Fast Wavenet Generation AlgorithmNov 29 2016This paper presents an efficient implementation of the Wavenet generation process called Fast Wavenet. Compared to a naive implementation that has complexity O(2^L) (L denotes the number of layers in the network), our proposed approach removes redundant ... More Deep attractor network for single-microphone speaker separationNov 27 2016Despite the overwhelming success of deep learning in various speech processing tasks, the problem of separating simultaneous speakers in a mixture remains challenging. Two major difficulties in such systems are the arbitrary source permutation and unknown ... More Invariant Representations for Noisy Speech RecognitionNov 27 2016Modern automatic speech recognition (ASR) systems need to be robust under acoustic variability arising from environmental, speaker, channel, and recording conditions. Ensuring such robustness to variability is a challenge in modern day neural network-based ... More MOMOS-MT: Mobile Monophonic System for Music TranscriptionNov 22 2016Music holds a significant cultural role in social identity and in the encouragement of socialization. Technology, by the destruction of physical and cultural distance, has lead to many changes in musical themes and the complete loss of forms. Yet, it ... More Robust end-to-end deep audiovisual speech recognitionNov 21 2016Speech is one of the most effective ways of communication among humans. Even though audio is the most common way of transmitting speech, very important information can be found in other modalities, such as vision. Vision is particularly useful when the ... More Noise reduction combining microphone and piezoelectric deviceNov 10 2016It is often required to extract the sound of an objective instrument played in concert with other instruments. Microphone array is one of the effective ways to enhance a sound from a specific direction. However it is not effective in an echoic room such ... More Domain Adaptation For Formant Estimation Using Deep LearningNov 06 2016In this paper we present a domain adaptation technique for formant estimation using a deep network. We first train a deep learning network on a small read speech dataset. We then freeze the parameters of the trained network and use several different datasets ... More Frame Theory for Signal Processing in PsychoacousticsNov 03 2016This review chapter aims to strengthen the link between frame theory and signal processing tasks in psychoacoustics. On the one side, the basic concepts of frame theory are presented and some proofs are provided to explain those concepts in some detail. ... More The Intelligent Voice 2016 Speaker Recognition SystemNov 02 2016This paper presents the Intelligent Voice (IV) system submitted to the NIST 2016 Speaker Recognition Evaluation (SRE). The primary emphasis of SRE this year was on developing speaker recognition technology which is robust for novel languages that are ... More SoundNet: Learning Sound Representations from Unlabeled VideoOct 27 2016We learn rich natural sound representations by capitalizing on large amounts of unlabeled sound data collected in the wild. We leverage the natural synchronization between vision and sound to learn an acoustic representation using two-million unlabeled ... More Voice Conversion using Convolutional Neural NetworksOct 27 2016The human auditory system is able to distinguish the vocal source of thousands of speakers, yet not much is known about what features the auditory system uses to do this. Fourier Transforms are capable of capturing the pitch and harmonic structure of ... More A model of infant speech perception and learningOct 19 2016Infant speech perception and learning is modeled using Echo State Network classification and Reinforcement Learning. Ambient speech for the modeled infant learner is created using the speech synthesizer Vocaltractlab. An auditory system is trained to ... More Making Mainstream Synthesizers with CsoundOct 16 2016For more than the past twenty years, Csound has been one of the leaders in the world of the computer music research, implementing innovative synthesis methods and making them available beyond the academic environments from which they often arise, and ... More Tonal consonance parameters expose a hidden order in musicOct 14 2016Consonance is related to the perception of pleasantness arising from the combination of sounds and has been approached quantitatively using mathematical relations, physics, information theory and psychoacoustics. Tonal consonance is present in timbre, ... More Maximum entropy models for generation of expressive musicOct 12 2016In the context of contemporary monophonic music, expression can be seen as the difference between a musical performance and its symbolic representation, i.e. a musical score. In this paper, we show how Maximum Entropy (MaxEnt) models can be used to generate ... More DNN based Speaker Recognition on Short UtterancesOct 11 2016This paper investigates the effects of limited speech data in the context of speaker verification using deep neural network (DNN) approach. Being able to reduce the length of required speech data is important to the development of speaker verification ... More Domain adaptation based Speaker Recognition on Short UtterancesOct 10 2016Oct 11 2016This paper explores how the in- and out-domain probabilistic linear discriminant analysis (PLDA) speaker verification behave when enrolment and verification lengths are reduced. Experiment studies have found that when full-length utterance is used for ... More On the Modeling of Musical Solos as Complex NetworksOct 03 2016Notes in a musical piece are building blocks employed in non-random ways to create melodies. It is the "interaction" among a limited amount of notes that allows constructing the variety of musical compositions that have been written in centuries and within ... More Very Deep Convolutional Neural Networks for Raw WaveformsOct 01 2016Learning acoustic models directly from the raw waveform data with minimal processing is challenging. Current waveform-based models have generally used very few (~2) convolutional layers, which might be insufficient for building high-level discriminative ... More