...
- "ROSETTA" is the abbreviation
of "Robot for Adapted Subtitling and All Translations."
This is a public-private research project
labeled by Cap Digital and co-financed by Bpifrance,
as part of the Future Investments Program.
The ambition of the ROSETTA project is to make audiovisual content
of all types more accessible to users.
For that,
ROSETTA develops systems for the automatic production
of multilingual and adapted subtitles.
ROSETTA also offers an exploratory translation
into French sign language,
using the animation of a 3D avatar signing in LSF.
This project is going on
over 3 years and 6 months, and it has 8 modules.
Module 1 is transverse. It coordinates project management and
communication between the different partners,
private companies and public laboratories.
Module 2 aims to collect and produce the corpus
that will serve for learning
and evaluation of automatic models.
Module 3 aims to produce, through neural networks,
French subtitles adapted for broadcasting and corresponding
to various audiences,
including the deaf and hard of hearing audience.
The goal of Module 4 is to automatically produce
multilingual subtitles, thanks to models
of neural translation specialized for the subtitling task
from French to English, Spanish, Italian,
Portuguese and Chinese.
Module 5 is dedicated to the generation of animation
of a 3D avatar signing in LSF, to experiment
the possibilities of translating directly into LSF
the content of television newspapers.
Module 6 aims to assess quality, utility and usability
of previous modules, from the perspective
both of experts in translation in LSF and production of subtitles
and users with their specific needs.
Module 7 attempts to anticipate the success of the project,
by questioning users about their expectations
and positioning the project
in relation to existing needs and practices.
Module 8, finally,
integrates all of the modules into a demonstrator.
It promotes the project
according to a common dissemination strategy
and accompanies the project's achievements
in their operating phase.
ROSETTA relies on recent developments
of artificial intelligence, particularly "deep learning"
applied to automatic translation.
And this, in different languages, and for areas as as varied
as entertainment, news or learning.
ROSETTA also relies on the movement recording
by Motion Capture and a multilinear representation
of sign language. These tools allow
to do experiments beyond subtitles,
in order to propose one day
access to news content directly in LSF.
ROSETTA addresses 3 direct targets.
1) Final users:
deaf people, hard of hearing people, people learning a foreign language
or wanting to access content in a language they master.
2) Corporations and organisms of production and distribution
of digital content, particularly
those who have an incentive to produce adapted subtitles
for much of their content.
3) Administrations, communication services,
media, training organisms
and any audiovisual content producer wanting to make it more accessible.
ROSETTA's prospects are of 3 kinds.
Provide greater access to audiovisual content of all types
to a wider population.
Then,
Automate the production chain and increase the productivity of audiovisual players.
Finally,
Understand the transformation of the accessibility market internationally.
SYSTRAN