1 00:00:00,167 --> 00:00:10,042 ... 2 00:00:12,542 --> 00:00:14,667 Mocaplab makes motion capture. 3 00:00:14,999 --> 00:00:16,959 It's a complicated term. 4 00:00:17,250 --> 00:00:20,000 Simply put, we are movement engineers, 5 00:00:20,334 --> 00:00:23,417 as there are sound engineers, we record, we edit, 6 00:00:23,751 --> 00:00:26,834 and we restore movement as a sound engineer 7 00:00:27,125 --> 00:00:29,834 records sound, edits and replays it. 8 00:00:30,125 --> 00:00:31,417 We record, 9 00:00:31,751 --> 00:00:33,999 we edit and restore movement. 10 00:00:34,292 --> 00:00:37,334 We do this for cinema, video games, VR, sports, dancing. 11 00:00:37,667 --> 00:00:40,083 Now we are going to do it for LSF. 12 00:00:40,417 --> 00:00:43,292 Sign language is exciting to work with. 13 00:00:43,626 --> 00:00:45,834 It's a very fine, very rich matter. 14 00:00:46,125 --> 00:00:49,918 We use it to communicate, so it's one of the most beautiful movement to study. 15 00:00:50,209 --> 00:00:53,375 First, you have to record it. It's complicated. 16 00:00:53,709 --> 00:00:57,125 We need to record the finger movement 17 00:00:57,459 --> 00:00:58,876 that's very fine-motion. 18 00:00:59,167 --> 00:01:02,417 Hands are very complicated to record. It's very subtle. 19 00:01:02,751 --> 00:01:05,417 So we had to record the quality 20 00:01:05,751 --> 00:01:08,167 of the hand movement, but also the face, 21 00:01:08,500 --> 00:01:11,334 whose deaf people use enormously, the eyes, the body, 22 00:01:11,667 --> 00:01:15,000 and record it in a very fine way, and all in parallel, 23 00:01:15,334 --> 00:01:20,459 because the hands have shapes, the body moves, the face too. 24 00:01:20,792 --> 00:01:23,292 It's kind of a multi-track record 25 00:01:23,626 --> 00:01:27,751 of what a deaf can produce in sign language. 26 00:01:28,042 --> 00:01:31,542 And then we're going to create a bunch of little samples 27 00:01:31,876 --> 00:01:35,209 of movements all over the place to recombine them 28 00:01:35,542 --> 00:01:38,876 and make it an avatar that signs pretty well. 29 00:01:39,167 --> 00:01:42,459 Recombining all these movements is not easy. 30 00:01:42,792 --> 00:01:44,334 From this multitrack, 31 00:01:44,667 --> 00:01:47,292 you have to mix all the movements 32 00:01:47,626 --> 00:01:50,042 to be fluid, coherent. 33 00:01:50,375 --> 00:01:52,751 It's a big part of the job. 34 00:01:53,042 --> 00:01:56,667 We had to develop a tool to record LSF very finely. 35 00:01:56,999 --> 00:01:59,834 It took 10 years, but now we have a tool that records. 36 00:02:00,125 --> 00:02:01,792 We record corpora, 37 00:02:02,083 --> 00:02:04,876 a lot of little examples of sign language, 38 00:02:05,167 --> 00:02:08,125 our partners mix them, and we have to resynthesize them 39 00:02:08,459 --> 00:02:11,417 to make a sentence in sign language that is fluid 40 00:02:11,751 --> 00:02:13,000 at all levels. 41 00:02:13,334 --> 00:02:17,083 And because it's full of different tracks and timelines, 42 00:02:17,417 --> 00:02:20,375 we developed this tool to mix them again. 43 00:02:20,709 --> 00:02:24,834 And then LSF experts give their feedback to improve the tool. 44 00:02:25,125 --> 00:02:27,626 Then we'll evaluate the quality of the result 45 00:02:27,959 --> 00:02:30,876 and ask the deaf what they think. 46 00:02:31,167 --> 00:02:34,459 It's kind of like voice synthesis a long time ago. 47 00:02:34,792 --> 00:02:37,834 The first one was complicated, hard, even unpleasant. 48 00:02:38,125 --> 00:02:40,209 But it was transmitting information. 49 00:02:40,542 --> 00:02:42,500 We wonder if the deaf 50 00:02:42,834 --> 00:02:46,125 will be happy with what we provide or if they'll be disappointed 51 00:02:46,459 --> 00:02:48,959 if the result is not very fluid 52 00:02:49,250 --> 00:02:51,167 or not respecting their language well. 53 00:02:51,500 --> 00:02:55,751 It's this first feedback that's the main expectation of the project 54 00:02:56,042 --> 00:02:59,292 that will allow us, hopefully, to continue to improve the tool, 55 00:02:59,626 --> 00:03:02,584 even though having a fluid, perfect sign language, 56 00:03:02,918 --> 00:03:04,667 is a long-term job. 57 00:03:04,999 --> 00:03:09,999 SYSTRAN