{"id":25365,"date":"2021-06-10T17:06:28","date_gmt":"2021-06-10T15:06:28","guid":{"rendered":"https:\/\/lium.univ-lemans.fr\/?p=25365"},"modified":"2021-06-11T09:32:46","modified_gmt":"2021-06-11T07:32:46","slug":"seminaire-martin-lebourdais-et-theo-mariotte","status":"publish","type":"post","link":"https:\/\/lium.univ-lemans.fr\/en\/seminaire-martin-lebourdais-et-theo-mariotte\/","title":{"rendered":"Joint effort on data loading process and its application to VAD, speaker turn detection and overlap detection"},"content":{"rendered":"

Seminar from Martin Lebourdais and Th\u00e9o Mariotte, PhD students at LIUM <\/h2>\n

 <\/p>\n

Date:<\/strong> 18\/06\/2021
\nTime:<\/strong> 11h00
\nLocalization:<\/strong>IC2 Salle des conseils, online<\/a>
\nSpeakers:<\/strong> Martin Lebourdais<\/a> and Th\u00e9o Mariotte<\/a><\/p>\n

 <\/p>\n

Joint effort on data loading process and its application to VAD, speaker turn detection and overlap detection<\/strong><\/p>\n

 <\/p>\n

Diarization is the task of finding \u201cWho spoke when?\u201d in an audio stream. It relies on two subtasks defined as segmentation and clustering. The former most often includes voice activity detection (VAD), overlapped speech detection (OSD) and speaker change detection (SCD). These three tasks are taking a sequence as input (audio signal) and outputting a sequence. The classification of the frames in the output sequence allows the segmentation of the audio signal, i.e. finding borders in the speech signal between different parts of interest.
\nOne difficulty when training such a system comes from the imbalance of the classes to be detected, especially in the case of overlap and speaker change detection.<\/p>\n

This work introduces a data loading process (DataLoader) to format and distribute the speech segments used for the training of these three tasks. In addition, to overcome the imbalance of the data, we propose a segment selection process (DataSampler) to precisely choose the proportion of examples of each class in each training mini-batch (speech, overlap, speaker change, non-speech). The data loading process also enable the use of multi-microphone recordings, which are investigated in the context of speech segmentation. Experimental evaluation is being carried out using the multi-microphone speech corpus AMI and the diarization challenge DiHard corpus.<\/p><\/div><\/div><\/div><\/div>

 <\/div>
 <\/div>
 <\/div><\/div><\/div>","protected":false},"excerpt":{"rendered":"

Seminar from Martin Lebourdais and Th\u00e9o Mariotte, PhD students at LIUM   Date: 18\/06\/2021 Time: 11h00 Localization:IC2 Salle des conseils, online Speakers: Martin Lebourdais and Th\u00e9o Mariotte   Joint effort on data loading process and its application to VAD, speaker turn detection and overlap detection   Diarization is the task of finding \u201cWho spoke when?\u201d […]<\/p>\n

READ MORE<\/span><\/i><\/span><\/a><\/p>\n","protected":false},"author":14,"featured_media":13238,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[43],"tags":[49],"acf":[],"_links":{"self":[{"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/posts\/25365"}],"collection":[{"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/users\/14"}],"replies":[{"embeddable":true,"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/comments?post=25365"}],"version-history":[{"count":0,"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/posts\/25365\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/media\/13238"}],"wp:attachment":[{"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/media?parent=25365"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/categories?post=25365"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/lium.univ-lemans.fr\/en\/wp-json\/wp\/v2\/tags?post=25365"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}