PAUL LACROIX 

Creative Technology Director / Engineer / Media Artist

Categories:    My pick  Interactive installations  Projection Mapping  Other  All

October 2020: Generative art - Vector field based virtual sculpture
NGC
At the occasion of the moving of their headquarters to Toyosu, the company NGC asked me to create a variation of one of my content so it can be placed in their lobby.

Displayed on 4 curved screens, the content evolves and changes perpetually. Colors and shapes, as well as camera work are generated randomly in real-time.
May 2020: Parted - Body Tracking and Projection Mapping (Personal project)
Daisuke Hashimoto / Paul Lacroix / Yae Doi / Mari Katayama
Creative Technologist

  • Technical direction
  • Creation of a system (hardware & software) able to smoothly track the performer body and accurately project video animations fitting the body shape

    • After several years experimenting on body projection mapping, this collaboration between Daisuke Hashimoto, Yae Doi and me represents a new step in the field of body projection mapping. The video is starring the Japanese artist Mari Katayama.

    Besides the cutting-edge technical aspect, we tried to create a peculiar visual, strongly inspired by the Japanese painter Ito Jakuchu. We also question the relation between identity and technology, as well as the perception of beauty and taboo within our societies.
    Video
    February 2020: Interactive hologram
    IBM Japan / Panasonic / TypeZero
    Technical director / Software developper

  • Software development

    • Developped as a front end demo for the AI interface Watson, this hologram interacts and provides information to customers visiting the head quarters of IBM Japan.
    May 2019: Markerless Face Projection Mapping on Bilal Hassani at Eurovision 2019
    French Delegation for the Eurovision / Takeru Shima (CG)
    Technical Director / Technology Developper

  • Technical direction
  • Customization of the markerless face projection system for live conditions

    • Eurovision Song Contest is a huge broadcasted live event followed by 200 million viewers. Part of the French delegation, I was in charge of the Face Projection Mapping. The system had to be installed on stage in only 40 seconds, so all calibrations and tests had to be completed before. I customized and optimized the system in order to increase its robustness for such a live event. The video is a little bit dark as the lighting technician forgot to switch on the backlights during the face projection, but the face tracking and projection mapping itself went well.
    Bilal Hassani / Eurovision 2019
    April 2019: The Lady in the Wood (Personal project)
    Paul Lacroix / Ryosuke Makita / Yae Doi
    Director / Technology developper

  • Direction, content creation
  • System development

    • Before this project, most of my facial projection mapping videos were shot in studio or at least in a location with easy access to electricity and light. The Lady in the Wood is an experiment aiming to evaluate the feasibility and robustness of using markerless face detection system in an uncontrolled environment. The video was shot in a small forest near Mont Fuji.
    Video
    March 2019: Experience Room (Art Installation) at Rolls Royce Motor Cars Shanghai
    Paul Lacroix / Dalbin
    Technical Director

  • Design of the technical solution and installation
  • 30 screens (5x3x2) for a total resolution of 19200x3240 pixels
    • Video
    October 2018: Interactive Bouldering Wall (Panasonic 100th anniversary)
    Panasonic / P.I.C.S. - http://www.pics.tokyo
    Engineer / Consultant

  • Consultant for high-speed tracking system and its integration
  • Development of a customized library for tracking on the wall
    • April 2018: Interactive Content (Hiroshima The Outlets/AEON)
    P.I.C.S. - http://www.pics.tokyo
    Software Engineer

  • Development of two interactive contents
  • Electronic interface for synchronizing the content with nearby elevator
    • Gachapon content video
    March 2018: Kamiboku x Facial Mapping: Merci
    P.I.C.S. - http://www.pics.tokyo / Recruit
    Technical Director / System Developper

  • Development of a Mobile Facial Projection Mapping System (hardware and software)
    • Merci (Official video)
    Merci (Behind the scenes)
    December 2017: Light Aquarium (Tokyo International Forum)
    P.I.C.S. - http://www.pics.tokyo
    Software Developer / Interaction Designer

  • Home-made position sensor
  • Development of two interactive contents
    • Light aquarium (Official video)
    October 2017: Vincent van Gogh - Face Projection Mapping (Tokyo Metropolitan Art Museum)
    TECHNONET - http://www.technonet.co.jp / Van Gaban
    Director / Face Projection Mapping System Developer

  • Direction of the content creation
  • Markerless tracking customized hardware development
  • Developpement of a non-rigid markerless tracking and projection mapping software
    • Official video
    October 2017: Interactive Content for Takashi Yanase Exhibition
    TECHNONET - http://www.technonet.co.jp
    Software Developer / Interaction Designer

    June 2017: EXISDANCE - Real-time tracking and projection mapping (Infocomm 2017 in Orlando)
    Panasonic / P.I.C.S. - http://www.pics.tokyo
    Technical Director / 3D Tracking Engineering

  • Use of the high-speed sensor/projector of Panasonic
  • Development of a custom 3D tracking approach for the upper body in live stage conditions
  • Integration into Unity3D
  • Use of my original synchronized media player for the background projectors
    • EXISDANCE at Infocomm 2017 (Official video)
    EXISDANCE at Infocomm 2017 (Behind the scenes)
    March 2017: Facial projection mapping for the Japanese promotion of Ghost in the Shell (Facial Hacking)
    P.I.C.S. - http://www.pics.tokyo
    Technical Director / Facial Projection Mapping Technology

  • Original motion capture system customized for facial projection mapping (hardware and software)
  • Upgrade of the facial projection mapping software Live Mapper
    • More technical details on my blog http://paul-lacroix.tumblr.com
    September 2016: Facial projection mapping for the music video The Come Down
    Collaboration with Empara Mi and Hiroto Kuwahara / P.I.C.S. - http://www.pics.tokyo
    Technical Director / Facial Projection Mapping Technology

  • Design of animated texture contents
  • Development of an original motion capture system customized for facial projection mapping (hardware and software)
  • Upgrade of the facial projection mapping software Live Mapper
  • Upgrade of the real-time reflective effect (mirror)
  • Creation of a new deep water effect
    • More technical details on my blog http://paul-lacroix.tumblr.com
    Empara Mi - The Come Down (Official video)
    Empara Mi - The Come Down (Behind the scenes)
    February 2016: Development and Installation of a Real-Time Virtual Character System at SEGA Joypolis (Shanghai and Tokyo)
    SEGA Live Creation - http://www.sega-live.com
  • Development and integration of an original system with a convenient workflow for content creators
  • Real-time full body motion capture and rendering, support of Lip sync
  • Support of multiple characters and props
    • January 2016: High-Speed Projection Mapping at CES 2016 (Las Vegas)
    Panasonic / P.I.C.S. - http://www.pics.tokyo
  • Consultant for Body Projection Mapping
  • Development of interactive contents demonstrating the capabilities of the new Panasonic's High-Speed Projection Mapping system
    • October 2015: Upgrade of the AR Clothes Fitting system (Osaka)
    Transit Digital Works - http://www.transit-dw.com
  • Customization of the system for business suits
  • System upgrade (multi-layer, auto-skinning, support of very high-resolution textures...)
  • Improvement of the calibration system
    • June 2015: Upgrade and Installation of the Virtual Character "Lopit" (Qingdao, China)
    SEGA Live Creation - http://www.sega-live.com
  • System adjustments
    • April 2015: Real-time Full Body Tracking & Projection Mapping (Paris, France)
    Dalbin - http://www.dalbin.com
    Technical Director

    Creation of a full body tracking and projection mapping system
  • Calibration system
  • Body tracking
  • Video texture projection
    • December 2014: Real-time Face Tracking & Projection Mapping for SMAPxSMAP (FUJI-TV)
    Link: http://www.face-hacking.com
    OMOTE members / YKBX
    Technical Director / System Architect

    New features of the Face Projection system:
  • Dual face projection mapping
  • Real-time relighting
    • September 2014: Installation of a 2D media server at Osaka Castle Park
    Indy associates / Sharp
  • Installation of original media server synchronizating video on multiple computers
  • 27 screens (9x3) for a total resolution of 11520x2160 pixels (3x4K)
  • Adjustment of the system to handle multiple audio tracks
    • August 2014: OMOTE / Real-time Face Tracking & Projection Mapping
    Link: http://www.project-omote.com
    Collaboration with Nobumichi Asai and Hiroto Kuwahara
    Technical Director / System Creator

    Design & Development of the Real-time Face Tracking and Projection Mapping System:
  • Calibration system (projector and OptiTrack devices)
  • Original face tracking algorithm
  • Video texture projection
    • July 2014: Interactive Seashore Floor Projection at Enoshima Aquarium
    Naked - http://www.naked-inc.com / Transit Digital Works - http://www.transit-dw.com
    Software Developper / Interaction Designer

  • Real-time water simulation
  • Interaction with infrared sensing data
  • "Night style" artistic rendering
    • July 2014: Simulation Program for Yokohama Dockyard Garden Projection Mapping (compatible with Oculus Rift)
    P.I.C.S. - http://www.pics.tokyo
  • Simulation in first-person view of projection mapping event (used for content check or presentation)
  • Support of Oculus Rift virtual reality headset when available
    • March 2014: Development of a 2D media server at Haneda International Airport
    Indy associates
    System Developper

  • Development of an original media server synchronizating video on multiple computers
  • Tools for data preparation and network synchronization
  • 36 screens (12x3) for a total resolution of 16392x2304
  • Technical support for interactive content on multiple screens
    • August 2013: Development of plugins for 3D Projection Mapping at Yokohama ORBI museum
    Link: http://orbiearth.com/jp
    SEGA
  • Design of the workflow for preparing contents
  • 3D Studio Max deformer plugin: alter the shape of 3D model of animals to fit a custom surface
  • After Effects plugin for easy preparation of the mapping contents
  • 3D Simulation software for preview
    • July 2013: Color correction system at Yokohama Dockyard Garden 3D Projection Mapping
    Link: http://www.youtube.com/watch?v=jyst4YhSEgg
    P.I.C.S. - http://www.pics.tokyo
  • Automatic color calibration of the wall for 8 projectors
  • Real-time color correction
    • 2013: Nuke plugin for realistic brush contours from 3D animation videos
    Polygon Pictures Inc. - http://www.ppi.co.jp
    November 2012: Consultant at Caretta Shiodome projection mapping
    Link: http://www.youtube.com/watch?v=fP9JlLS0tQo
    Polygon Pictures Inc. - http://www.ppi.co.jp
  • Design of the content workflow
  • Projection simulation
    • July 2012: Image Technical Director for the renewing of SEGA Tokyo Joypolis
    Link: http://tokyo-joypolis.com/stageshow
    Polygon Pictures Inc. - http://www.ppi.co.jp
  • Design and development of the system of real-time 3D virtual character
  • Evaluation of several 3D Projection Mapping systems
  • Design of the reference content templates and development of an After Effects plugin for template transformation
  • 3D Simulation software for preview
    • April 2012: Project Leading Engineer on AR Garment Fitting Project
    Link: http://www.youtube.com/watch?v=gguTQHfoD_8
    Transit Digital Works - http://www.transit-dw.com
  • Research and Development, system design
  • Real-time cloth physics simulation
  • Kinect skeleton data filtering/retargeting, improvement of the body detection quality
  • Cloth database management system
    • January 2012: Interactive content for the 100 Years anniversary of Sharp
    Ittocan - http://www.ittocan.co.jp
    Design Concept Graphic User Interface using both touch screen and Kinect motion sensing
    November 2011: Consultant at Seikei University 3D Projection Mapping
    Link: http://vimeo.com/33150921
    P.I.C.S. - http://www.pics.tokyo / Polygon Pictures Inc. - http://www.ppi.co.jp
    Technical supervisor / Software Developper

  • Technical Supervision
  • Creation of a After Effects plugin for wall color correction
    • October 2011: Interactive content at Ecobuild event (Tokyo International Forum)
    Ittocan - http://www.ittocan.co.jp
    Technical Director / Interaction Designer

    Multiple screens (8K pixels wide), double camera sensing
    August 2011: Consultant for optimizing the project management workflow on the TV series Transformers
    Polygon Pictures Inc. - http://www.ppi.co.jp
    June 2011: Nuke cutout filter with temporal stability used in the TV serie Tron Uprising
    Polygon Pictures Inc. - http://www.ppi.co.jp
    March 2011: Nuke plugin for automatic normal map generation from handmade celluloid used in the TV serie Tron Uprising
    Polygon Pictures Inc. - http://www.ppi.co.jp
    2010: Realistic brush animation software
    Polygon Pictures Inc. - http://www.ppi.co.jp
  • Real time drawing capture
  • Stroke path edition
  • Progressive stroke drawing
  • Object animation with spline interpolation
  • Real-time preview and high quality rendering
  • User interface developed using Qt
    • September 2010: Interactive content at Sky Hall Penthouse Wedding
    Widget Inc.
    October 2010: Interactive content at Sign Kasumigaseki
    Widget Inc. / JET Agency
    February 2010: Interactive contents at Aquamarine Fukushima
    Widget Inc.
    Technical Direction / Interaction Designer

    November 2009: Interactive content for the live show Keio NetBand Wa-i
    Link: http://www.youtube.com/watch?v=x8wrUYP4uRE
    Widget Inc.
    2009: Real time fluid manipulation software used within introduction videos of a video game
    Polygon Pictures Inc. - http://www.ppi.co.jp
  • Fluid and particle simulation
  • Real time drawing, edition and visualization
  • Importation of camera data from MAYA
  • User interface developed using MFC
    • 2009: Conception and management of an interactive digital signage project
    Widget Inc.
  • Research and development about visual sensing algorithms used with standard camera (motion and position estimation, face detection and tracking)
  • Promotion (website, documents, presentation video editing)
  • Customer relations, project budget estimation
  • Design of interactive content by using Flash or C++/OpenGL
  • Development of customizable content templates and their IDE
  • System installation, calibration and maintenance
    • 2008: Work on a real-time video compositing embedded system for karaoke
    Widget Inc.
  • Development of an ActiveX Control performing camera capture, compositing and recording to MPEG-2 file
  • Creation of customized DirectShow filters
  • Programming of software adjusting automatically the volume amplitude of audio data (robust approach)
  • Evaluation of several video compression formats for optimal display on mobile phone
  • Programming of software/hardware/network diagnostic software
  • Prototyping of a new interface connecting two devices in order to decrease the system cost
    • 2008: Volume rendering of brain sequences for the new version of the animation movie Ghost In The Shell 2.0
    Polygon Pictures Inc. - http://www.ppi.co.jp
    Ghost in the Shell 2.0 Trailer
    2007: Development of a real-time task management Web application used for organizing the tasks of more than one hundred employees
    Polygon Pictures Inc. - http://www.ppi.co.jp
    This application was used in the context of the American TV series My Friends Tigger and Pooh
    2006: Software research and development
    Voxelan
  • Digital measurements on 3D models
  • Scan anonymization
  • Scan stitching
  • Documentation, demonstration and training related with the software
  • Upgrade of the company 's website
  • Research and evaluation of methods especially in the following fields:
  • Processing of images and depth maps (Digital Elevation Model)
  • Scanner calibration, correction of the lens distortion
  • Mesh operations (polygonization, merging, simplification, comparison, positioning...)
  • Use of various data structures for optimization (octree, kd-tree...)
    • 2004: Development of visualization and processing software for volume images
    Pierre Fabre - http://www.pierre-fabre.com
  • Reading volume data from DICOM files
  • Volume data processing
  • Programming of a volume rendering engine (real-time mode with texture stack approach, high quality mode with ray casting algorithm)
  • Polygonization of vascular network
  • Participation in the authoring of a software development normalization document
  • Software training
    • 2003: Development of control software for a 3D scanner used in dermatology
    Pierre Fabre - http://www.pierre-fabre.com
  • Calibration of a vision system
  • Construction of 3D mesh from profilometer data
  • Color correction
  • Projection/merging of 2D textures on the 3D mesh
  • Research about mesh construction algorithms, publication of an article
    • Copyright (c) 2009-2021 Paul Lacroix