Curriculum Vitae

Philippe Esling
c/o IRCAM
1, Place Igor Stravinsky
F-75004 Paris, France

Born on 14/09/1984
in Metz, France

Associate professor - University Paris 6 - UPMC
PhD - Acoustics, Signal Processing and Informatics
IRCAM - CNRS UMR 9912
Music Representations team
http://esling.github.io

Short version

Education

199? PhD Name of Faculty/ Department, Name of University/ Institution, Country Name of PhD Supervisor Awarded on 10/12/2012 199? Master Name of Faculty/ Department, Name of University/ Institution, Country

Current position

2013 Associate Professor at Université Pierre et Marie Curie (UPMC) - Current situation
Responsable de l’axe de recherche Orchestration à l’IRCAM

Previous positions

2013 Post-Doctorate Fellow at Université de Genève
Post-doctorat en métagénomique et analyse de diversité des séquences génétiques
2009-12 Doctorate at IRCAM and Université Pierre & Marie Curie
Doctorate in signal processing and musical informatics - Mention Très Honorable.
2008-09 Institut de Recherche et Coordination Acoustique / Musique (IRCAM)
Masters in acoustics, signal processing and musical informatics - Mention Très Bien.
2007-08 Université Pierre et Marie Curie, paris 6
Masters in distributed systems and applications - Mention Très Bien, 1st in year.
2005-07 Université Pierre et Marie Curie, paris 6
Bachelors in informatics and mathematics - Mention Très Bien. 1st in year

Awards

2013 1st Prize for best PhD from the General Council PhD prize for thesis on computer-assisted orchestration and multiobjective time series matching 2011 Tokyo Wonder Site Experimental festival Open 2010 AFIM Young Researcher Award 2010 Research prize for the intelligent time series query system 2009 EDITE Grant for doctoral studies

International mobility

2015 McGill University, Montreal, Canada - Invited researcher for 2 months 2013 UNIGE University, Geneva, Switzerland - Post-doctoral fellow for 1 year 2012 McGILL University, Montreal, Canada - Invited PhD for 3 months 2011 JFLI, Todai University, Tokyo, Japan - Invited PhD for 6 months

Fellowships

200? – 200? Scholarship, Name of Faculty/ Department/Centre, Name of University/ Institution/ Country 199? – 199? Scholarship, Name of Faculty/ Department/Centre, Name of University/ Institution/ Country

Supervision of graduate and post-doctoral students

200? – 200? Number of Postdocs/ PhD/ Master Students Name of Faculty/ Department/ Centre, Name of University/ Institution/ Country

Teaching activities

200? – Teaching position – Topic, Name of University/ Institution/ Country 200? – 200? Teaching position – Topic, Name of University/ Institution/ Country Across my different academic positions, I gave a wide panel of teaching in informatics and mathematics over at different levels. All these teachings are summarized in table [tab:Résumé-des-volumes]. I have been participating to all organization meetings for both the Master 2 ATIAM from IRCAM and the Master 1 STL from UPMC.

Year Level Name UE Nb CM TD TP Volume
2015 M2 Paradigme prog. concurrente NI407 12 12 - - 12
2015 M2 Insertion pro. (IP) NI001 25 4.5 - - 4.5
2015 M2 Music Machine Learning MX130 25 15 - 6 21
2015 M1 Projet Androide MI042 3 - 9 - 9
2015 M1 Programmation répartie MI019 29 - 20 20 40
2015 L3 Modèle de program. (MPIL) LI332 27 - 20 20 40
2015 L3 Program. Java 2 LE380 16 21 14 - 35
2014 M2 Paradigme prog. concurrente NI407 15 4.5 - - 4.5
2014 M2 Insertion pro. (IP) NI001 15 4.5 - - 4.5
2014 M1 Data mining (DMKM) MX130 5 - 15 - 15
2014 M1 Projet STL MI042 3 - 9 - 9
2014 M1 Program. concurrente MI019 29 - 20 20 40
2014 L3 Modèle de program. LI332 27 - 20 20 40
2014 L3 Program. Java 2 LE380 16 21 14 - 35
2014 L1 Program. récursive LI101 31 - - 21 21
2012 M2 Publication scientifique IP 22 4.5 - - 4.5
2011 L1 Scheme LI101 63 - 45 30 75
2011 L2 Projet Robotique LI260 21 - 30 20 50
2011 L1 Puce au web LI105 23 - - 21 21
2009 LX Programmation LXTI 19 - 22.5 15 37.5
2009 LX Projet électronique LE01 19 - 22.5 15 37.5
Total 87 261 208 556        

In the past years, I have also taken responsibility and are still the main supervisor or co-supervisor of several teaching units, for which I produced teaching materials:

LE380 Java L2 - Mobile platforms object-oriented development
M2003 Concurrent and reactive programming
NI407 Music Machine Learning (in musical informatics)

Organisation of scientific meetings

2016 Direction and organisation of mensual conference DoMuX at IRCAM, Paris 2015 Organisation of IRCAM Workshop at SMC 2016, Darmstadt, Germany 2014 Co-direction and organisation of mensual conference MaMuX at IRCAM, Paris 10 meetings per year with notable participation of Alain Connes, Shihab Shamma and John Weardey 2014 Organisation of conference Eukaryotic-omics, UNIGE, Geneva 2011 Organisation of conference MCM 2011, IRCAM, Paris 2010 Organisation of conference JJCAAS 2010, IRCAM, Paris

Institutional responsibilities

201? – Faculty member, Name of University/ Institution/ Country 201? – 201? Graduate Student Advisor, Name of University/ Institution/ Country 200? – 200? Member of the Faculty Committee, Name of University/ Institution/ Country 200? – 200? Organiser of the Internal Seminar, Name of University/ Institution/ Country 200? – 200? Member of a Committee; role, Name of University/ Institution/ Country

2013-16 Direction of the Orchestration research axis at IRCAM 2014 Co-Direction of 2 PhDs at IRCAMPierre Talbot, Leopold Crestel 2012 Creation and direction of the Orchestration Workgroup - IRCAM, Paris 2014 Creation of the new teaching plan - Master 2 ATIAM - UPMC 2014 Creation of a new teaching unit - Music Machine Learning, Master 2 ATIAM - UPMC 2014 Creation of a new teaching unit - Java L2 - Mobile platforms object-oriented development - UPMC 2014 Creation of the new teaching plan - Master 1 STL - UPMC

Commissions of trust

201? – Scientific Advisory Board, Name of University/ Institution/ Country 201? – Review Board, Name of University/ Institution/ Country 201? – Review panel member, Name of University/ Institution/ Country 201? – Editorial Board, Name of University/ Institution/ Country 200? – Scientific Advisory Board, Name of University/ Institution/ Country 200? – Reviewer, Name of University/ Institution/ Country 200? – Scientific Evaluation, Name of University/ Institution/ Country 200? – Evaluator, Name of University/ Institution/ Country

2015 Mid-PhD Jury - Xavier Renard (Lip6, Arcelor mittal) - UPMC, ParisMultivariate time series classification for industrial monitoring. 2014 Jury de stage de Master 2 - IRCAM (ATIAM 2014) 2014 Associate professor selection comity (CdS) N°4259 Poste de maître de conférence à l’UPMC (Poste n°4259, Section 27 UPMC) 2013 Jury de stage de Master 2 - IRCAM (ATIAM 2013) 2012 Jury de stage de Master 2 - IRCAM (ATIAM 2012)

Memberships of scientific societies

201? – Member, Research Network “Name of Research Network” 200? – Associated Member, Name of Faculty/ Department/Centre, Name of University/ Institution/ Country 200? – Funding Member, Name of Faculty/ Department/Centre, Name of University/ Institution/ Country

Major collaborations

Name of collaborators, Topic, Name of Faculty/ Department/Centre, Name of University/ Institution/ Country

Funded projects

2016 SNF Fund project for industrial development 2014-2017 Main coordinator - International partnership ANR-SSHRC IRCAM and McGill University on computer-assisted orchestration 2015 PhD Grant - EDITE 2015 NVIDIA GPU grant 2015 NVIDIA Research Center grant 2014 PhD Grant - EDITE 2013 Funding project CoInf - Metagenomics (Geneve, Switzerland) High-throughput DNA Sequencer

 Mention a distinct funding ID, which shows how much you are able to raise and manage funding. Use Euro. The funding ID will not count towards page limits. It must follow the table format indicated in the Part B1 template: On-going Grants Project Title Funding Source Amount (€) Period Role of the PI Relation to current ERC proposal

Key Publications

 Use indexes, summaries…  The competition is high. The evaluators should see your excellence at once! Sell yourself, without bluffing.  Describe clearly any scientific overlap between your ERC application and the current research grant or on-going grant application.

Early achievements track-record

 List your activities as stated in the Information for Applicants p. 24.

Most representative publications

 Don’t forget to list 5 representative publications and highlight those without the presence of your PhD supervisor (minimum 1).  Choose the achievements that are highly valuated in YOUR domain. It depends a lot on the domain if it’s rather first authorship, last authorship, conference proceedings etc.  The publications are the part the evaluators seem to be most interested in.  No repetition from the CV necessary. Don’t give the same information twice.  You can comment on your publications.

Scientific excellence is the sole criterion, subject of evaluation is the pair (principal investigator).

Competitive candidate must have shown potential for research independence and evidence of maturity.
At least one important publication without the participation of their PhD supervisor.

Promising track record of early achievements appropriate to their research field and career stage, including significant publications (as main author) in major multidisciplinary scientific journals, or in the leading journals of their field. They may also demonstrate a record of invited presentations in well-established international conferences, granted patents, awards, prizes etc

In the Track record the applicant PI should list:

  1. Up to five publications in major journals, conferences proceedings and/or monographs of their respective research fields, highlighting those without the presence as co-author of their PhD supervisor, and the number of citations (excluding self-citations) they have attracted (if applicable);
  2. Research monographs and any translations thereof (if applicable);
  3. Granted patent(s) (if applicable);
  4. Invited presentations to peer-reviewed conferences and/or international advanced schools (if applicable);
  5. Prizes/ Awards / Academy memberships (if applicable).

CV analysis:

  • Publications without the PhD Supervisor VS Total number of publications No researchers with zero publications without the PhD Supervisor
    Considering the CVs investigated on average the publications without the PhD Supervisor are 59,4% More than half of researchers have more than 20 publications without their PhD supervisor

  • International Mobility 18/19 PIs have at least one important international experience In 2 cases with few experiences abroad, lots of mobility within the country of origin and huge participation in international events
    The minimum stay (1 case) is 2 months Experiences are mainly long periods (more than one year)

  • Examples of Prizes and Awards

Evaluation type A :

  • Several publications are single-authored showing research independence and creativity.
  • Important research mobility
  • The track record involves many publications in high end journals and the citations are very good and promising considering age of the applicant. Also number of invited talks and supervision of students are above average and guarantee a high degree of scientific independence of the application
  • World-leading expert in his field with several important research achievements of wide impact in the community. He is a main player of his field.
  • His achievements and publications are truly ground-breaking. Number of citations of his papers exceeds 2000 and his h-index is 27, which is truly impressive at the PI’s career stage. The papers demonstrate his independent and creative thinking and his capability to go significantly beyond the present state of the art.
  • The PI is an exceptionally innovative and active young scientist, holding a permanent position at a leading university. The list of tasks with a significant leading role is long demonstrating the PI’s ability to lead scientific project in an international environment. Also the list of presentations at international conferences, workshops and seminars proves the confidence he enjoys from collaborators
  • The PI is an outstanding young scientist who already at a young age has made a strong impact evidenced by publishing a review in his field of research, and has become a very important reference in this field. He has publications in high-impact journals and has achieved extremely high citations and a very high Hirsch index. He has strong international collaborations with the most important groups. He has already established his independence through building a reasonable group of post-docs and PhD students under his supervision. He has teaching experience through lecturing at the various departments and institutes where he spent extended periods. He has also contributed to public outreach. He has been (co-)organiser of several workshops and conferences and has been invited to give review talks at many international conferences.

Innovative pedagogy actions

Music machine learning

The new trends in computing place an increasing emphasis on machine learning (ML) techniques. However, these aspects were not taught inside the ATIAM Master prior to my arrival. I decided to develop a teaching centered on various ML algorithms, applied to musical information. I created both the lesson plan and materials. I also developed an extensive tutorial, which can be seen as a series of missing code exercices targeted at understanding the fundamental notion and equations in each technique. Slides and tutorial available at http://repmus.ircam.fr/esling/atiam-ml.html.

Concurrent and reactive programming

This unit that has been recently created in the STL Master at UPMC, was mainly coordinated and created by Carlos Agon, but I took an active part in the creation of all aspects and projects related to reactive programming. Hence, thanks to a collaboration set up with ESTEREL Technologies, we obtained academic licences for the students, so that they can learn a widespread language used by multiple avionics, electricity and transport companies. I also bought several drones, so that this year the project will be to program an autonomous drone to perform a topographic map of a room. Project and details are available at https://www-master.ufr-info-p6.jussieu.fr/2015/PPC.

Java L2 - Mobile platforms object-oriented development

This unit is given as part of an industrial training bachelor at UPMC. I took the main coordination and organization of this unit, by recreating the whole schedule and corresponding materials. As students chose this formation in order to find a job in the industry, I focused my teaching on applications that are currently well-seeked . Therefore, even though theoretical aspects are given, all applications are targeted at both Web development and mobile (Android and iOS) platforms. Current slides and description are available at http://repmus.ircam.fr/esling/java.html.

Other teaching units

In multiple teaching units, notably MPIL (LI332) and PC2R (MI019), I proposed to devise innovative projects for applying the newly acquired coding skills of students to projects with musical applications. I believe that projects with an increased interest to its endeavor will drive students to work out of passion rather than obligation.

Jury participations

Originality of research and major results

Automatic computational orchestration

Since taking position at IRCAM on September 2013, I am responsible for directing and coordinating the research axis on musical orchestration. In this context, I worked towards the development of innovative algorithms and interfaces for computer-aided orchestration, by developing new heuristic approaches for approximating orchestral targets and complex temporal articulations. This work led to the first computer-aided orchestration software called Orchids in November 2014. This software is the first to provide a way to recreate any sound with a musical orchestra, and is sold through the IRCAM Forum, with a worldwide community of several thousands of users.

Creative artificial intelligence

Since 2014, I have been working . By using ideas derived from deep neural network learning, the goal is to provide new ways to understand the creative processes underlying musical orchestration. Together with a PhD student, we developped the first prototype of a software able to produce a musical orchestration from a simple piano input, in real-time.

Multiobjective time series matching

I pursued theoretical researches on time series (ACM Computing Surveys, 2012) that subsequently raised a question yet to be challenged in the scientific literature. I introduced the idea to assess the similarity of multiple decorrelated temporal evolutions through a flexible multiobjective framework, called Multi-Objective Time Series (MOTS) matching. The idea of this paradigm is to take into account the multidimensional aspects of all elements studied based on multiple temporal structures. Thus, the similarity of different temporal forms is studied jointly without mixing the different measures of distance, addressing any research problem centered on temporal analysis by providing multidimensional similarities for temporal forms. These paradigms of innovative data mining have been extended to classification problems and also achieved excellent results in bio-monitoring, cardiology, robotic, climatology.

Environmental monitoring through DNA

The analysis of bio-diversity through Next-Generation Sequencing (NGS) to monitor the environmental state through DNA communities in the deep sea. However, the characteristics of NGS datasets produce hundreds of millions of DNA sequences. I developed analysis algorithms to include the temporal evolution of biological diversity through treatment of massive sequencing of several billion ancient DNA sequences. My work resulted in the publication of numerous studies in journals with high impact factor, but also the advent of two first-of-kind computer software for parameter-free clustering used by several teams of molecular biologists. The development of these software continues to this day due to the interest of the scientific community for them.

Industrial relationships

2015 Collaboration with ID-Gene, Geneva, SwitzerlandEnvironmental monitoring through NGS Sequencing. 2011 Collaboration with INFRAL, Strasbourg, FranceHeart diseases detection 2011 Collaboration with Native Instruments, Berlin, GermanyAudio databases mining

Reviewing activities and jury

2015 Plos One Journal 2014 Data Mining and Knowledge Discovery (DMKD) journal 2013 IEEE Acoustics, Speech, and Signal Processing (ICASSP 2013) 2012 Mathematics and Computation in Music (MCM 2012) 2011 International Computer Music Conference (ICMC 2011) 2010 Journées Jeunes Chercheurs en Acoustique Audition et Signal (JJCAAS 2010)

International mobility help

Regarding international mobility, I try to engage as much as possible so that my PhD student can all perform at least a part of their research in an international laboratory. My first PhD (Pierre Talbot) is currently performing an invited research at the National Institute of Informatics (NII) in Tokyo, Japan, thanks to an international funding that we set up. I am also actively setting up a collaboration with McGill University to facilitate the student exchange program with IRCAM.

Professionnal insertion

I am an active teacher for the professional insertion course given at IRCAM for the ATIAM Masters. In that framework, I am giving two main courses

• Scientific publication (3 hours) is a lesson given in english in order to provide students with the basis of both scientific publication and different aspects of research workflows.

• Scientific carreer (3 hours) is a lesson centered on the different aspects of a carreer in academia. Students are sensitized to different ways to apply for a PhD and what is implied along a scientific career.

Innovative pedagogy actions

Music machine learning

The new trends in computing place an increasing emphasis on machine learning (ML) techniques. However, these aspects were not taught inside the ATIAM Master prior to my arrival. I decided to develop a teaching centered on various ML algorithms, applied to musical information. I created both the lesson plan and materials. I also developed an extensive tutorial, which can be seen as a series of missing code exercices targeted at understanding the fundamental notion and equations in each technique.

Students targeted: Master 2 research students

Competences targeted: Optimization, Data mining, Machine Learning

Technologies used: Matlab, Torch and CUDA

Dates: 2014-2016

Team involved: Musical representation (IRCAM)

Slides and tutorial available at http://repmus.ircam.fr/esling/atiam-ml.html.

Concurrent and reactive programming

This unit that has been recently created in the STL Master at UPMC, was mainly coordinated and created by Carlos Agon, but I took an active part in the creation of all aspects and projects related to reactive programming. Hence, thanks to a collaboration set up with ESTEREL Technologies, we obtained academic licences for the students, so that they can learn a widespread language used by multiple avionics, electricity and transport companies. I also bought several drones, so that this year the project will be to program an autonomous drone to perform a topographic map of a room.

Students targeted: Master 2 professional students

Competences targeted: Reactive programming, avionics

Technologies used: ESTEREL, SCADE

Dates: 2014-2016

Team involved: Science et Technologie du Language (STL, UPMC)

Project and details are available at https://www-master.ufr-info-p6.jussieu.fr/2015/PPC.

Java L2 - Mobile platforms object-oriented development

This unit is given as part of an industrial training bachelor at UPMC. I took the main coordination and organization of this unit, by recreating the whole schedule and corresponding materials. As students chose this formation in order to find a job in the industry, I focused my teaching on applications that are currently well-seeked . Therefore, even though theoretical aspects are given, all applications are targeted at both Web development and mobile (Android and iOS) platforms. In that formation, I am also an active tutor for 2 students each year, by following their evolution inside their companies and meeting with their industrial directors.

Students targeted: Licence 3 professional students

Competences targeted: Web development, Mobile applications, Object-oriented

Technologies used: Java, Android SDK, OpenGL

Dates: 2014-2016

Team involved: Multimedia and Web

Current slides and description are available at http://repmus.ircam.fr/esling/java.html.

Other teaching units

In multiple teaching units, notably MPIL (LI332) and PC2R (MI019), I proposed to devise innovative projects for applying the newly acquired coding skills of students to projects with musical applications. I believe that projects with an increased interest to its endeavor will drive students to work out of passion rather than obligation.

Pedagogy responsabilities

Teaching unit director Java L3 - Mobile platforms object-oriented development (LE380) 2013/2014, 2014/2015, 2015/2016 Professionnal licence Multimédia et Web ~30 students / year 40h/year

Teaching unit co-director Concurrent and reactive programming (MI003) 2014/2015, 2015/2016 Master 2 Sciences et Technologies du Language (STL) ~20 students / year 12h/year

Teaching unit director Music Machine Learning (in musical informatics) 2014/2015, 2015/2016 Master 2 ATIAM (IRCAM) ~25 students / year 20h/year

Pedagogy team meetings and organisation Master 2 ATIAM (IRCAM) 2013/2014, 2014/2015, 2015/2016

Pedagogy team meetings and organisation Master 2 STL (UPMC) 2013/2014, 2014/2015, 2015/2016

Supervision 2015 PhD supervision 3 years - Léopold Crestel - “Real-time generation of orchestral works through deep temporal learning”. 2014 PhD supervision 3 years - Pierre Talbot - “Non-deterministic Temporal Constraint Calculus for big musical data”. 2015 Master 2 supervision 6 months - Léopold Crestel - “Real-time orchestral generation through deep temporal learning”. 2014 Master 2 supervision 6 months - Pierre Talbot - “Compiler for Non-deterministic Temporal Constraint Calculus”. 2014 Master 2 supervision 6 months - Henri NG - “Automatic knowledge inference from multivariate time series for musical orchestration” 2014 Master 2 supervision 6 months - Marion PILTE “Orchestral pieces generation through constraints networks” 2013 Engineer supervision 1 year - Antoine Bouchereau - “Computer-Aided Orchestration software”. 2012 Master 2 supervision 6 months - Maria MARONNE - “Non-Markovianity in temporal processes for orchestration” 2012 Master 2 supervision 6 months - Evangelia KOLIOPOULOU - “Analyseis and classification of sound morphology” 2011 Engineer supervision 6 months - Jordan GERBER - “Multiobjective techniques for sound retrieval” 2010 Bachelor supervision 3 months - Pierre LECOMTE - “Perceptual effects of sound mixtures”