Publications and Data
- Always monitor what you are shooting for the intended distribution dynamic range on set (with some degree of error allowed, of course.) Details may go unseen which could make the captured images unusable for an HDR version.
- Choose a single hero format to light and shoot for - don't bake a compromise between the two into the source material. The material can be often be adapted appropriately for all other delivery formats by a skilled colorist.
- Over-use of image highlights (occupying too much screen time or area) will dull the viewer’s sensitivity and lose the HDR effect. Properly shot, sparse specular highlights allow for a visually stunning use of the upper range.
- Tools which are not developed with the format in mind can often have their functionality broken by HDR material. Consult with technology developers on whether their products were significantly tested with HDR workflows.
- Proof content on a range of display technology types as their varying capabilities may impact creatively relevant image details.
- Perform individual grades for HDR and SDR to maximize benefits of each, then masters for intermediate ranges can be generated by blending between these approved image states. Automatic conversion techniques implemented by content distributors or within display devices should not be trusted to preserve your artistic intentions.
More detailed descriptions of the work conducted for the project, as well as contact info for sourcing the HDR footage shot throughout the project can be found here: https://www.upf.edu/web/hdr4eu/publications. For the case of many challenges listed throughout the document, project partners already offer developed solutions. Their respective websites can be found here: https://www.upf.edu/web/hdr4eu/participants.
While we hope readers find these guidelines helpful, we acknowledge that the best way to learn how to create excellent HDR imagery is through hands-on experimentation. We strongly encourage the reader to produce their own HDR content and play a part in defining the medium.
Final Dissemination Showcase
While the visual impact and the heightened realism of HDR imagery work spectacularly well if used carefully, it also shows the dangers of ignoring the need for multiple versions for distribution. Critical HDR monitoring during the shoot is important for taking full advantage of the camera’s high dynamic range.
The video addresses the Directors of Photography and other content creators and helps building confidence in shooting for HDR by being open about the potential difficulties.
The video addresses the large community of not-yet-professionals and shows how a new generation of content creators can get familiar with HDR, explore its advantages and build confidence in the underlying technology.
The video presents this genuinely groundbreaking academic research with clear visual examples in an understandable form, showing both the relevance of this research for the practical implementation of HDR tools as well as the further understanding of how we perceive and decode colour information in response to different viewing environments.
The research has been submitted for publication in the relevant academic vision science publications and is bound to find interest well beyond the specific field of HDR content creation and consumption.
In turn this required a re-write of the internal rendering engine, introducing more photorealism and physics based rendering even for SDR workflows. The support of the HDRE file format developed by UPF for 3D assets shows close integration between partners. The inclusion of an automatic exposure control tool as well as an eye-adaptation tool show the application of the project academic research in the commercial product.
The video addresses the broadcast market, which is pushing for practical and productive solutions in the area of live-action virtual studio production. With Brainstorm working in close cooperation with its clients, industry acceptance and adoption will follow.
During the course of the project 3 technical shootings were performed with the objectives of:
- Capturing technical content for testing and validation of the HDR tools and pipeline.
- Providing suitable solutions for the ‘on-set’ visualisation of the captured material.
1. Initial HDR Technical Shooting: S&M and all partners suggested to ARRI a list of content to be captured that would later be used for testing techniques, creating exemplary content and evaluation of the HDR tools and pipeline. The shooting was done with provided equipment and resulted in test material for various applications of HDR, such as: Scenic productions, Documentary, Sports, Stage shows and concerts.
2. Enhanced HDR Technical Shooting: The second technical shooting allowed partners to shoot content using their enhanced HDR tools already developed by the project. The shot footage was a combination of:
- Similar content to the initial shoot so that qualitative validation could be performed as part of the enhanced HDR pipeline.
- New content that would allow demonstration/validation of the new tools.
S&M and all partners suggested to ARRI a complete list to shoot during this second phase of the project and the footage allowed S&M to do their benchmark evaluation.
3. Production Shooting: The final shoot was an actual production in which S&M engaged with one of its clients to arrange on-set access so that the tools would be used in a proper production environment. This allowed the footage to subsequently be used for further validation and demonstration of the HDR pipeline and tools. S&M used the captured footage as part of their Global Professional Validation.
*To download data from the technical shootings please contact [email protected]
- Rodríguez RGil, Vazquez-Corral J, Bertalmío M. 2020. Color matching images with unknown non-linear encodings. IEEE Transactions on Image Processing.
- Thanh OVu, Canham T, Vazquez-Corral J, Rodríguez RGil, Bertalmío M. 2020. Color stabilization for multi-camera light-field imaging. ICASSP.
- Canham T, Vazquez-Corral J, Mathieu E, Bertalmío M. 2020. Matching visual induction effects on screens of different size by regularizing a neural field model of color appearance. Submitted.
- Cyriac P, Canham T, Kane D, Bertalmío M. 2020. Vision models fine-tuned by cinema professionals for High Dynamic Range imaging in movies. Multimedia Tools and Applications.
- Rodríguez RGil, Vazquez-Corral J, Bertalmío M. 2019. Issues with common assumptions about the camera pipeline, and their impact in HDR imaging from multiple exposures. *Accepted* in Siam Journal on Imaging Sciences.
- Grimaldi A, Kane D, Bertalmío M. 2019. Statistics of natural images as a function of dynamic range. *Accepted* in Journal of Vision.
- Zamir SWaqas, Vazquez-Corral J, Bertalmío M. 2019. Vision models for wide color gamut imaging in cinema. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI).
- Sugito Y, Bertalmío M. 2018. Performance evaluation of objective quality metrics on HLG-based HDR image coding. Global Conference on Signal and Information Processing (GlobalSIP).
- Zabaleta I, Bertalmío M. 2018. Photorealistic style transfer for cinema shoots. Proceedings of Colour and Visual Computing Symposium (CVCS).
- Canham T., Bertalmío M. 2020. The persistent influence of viewing environment illumination color on displayed image appearance. *accepted* London Imaging Meeting.
- Canham T., Long D.L., Fairchild M.D., Bertalmío M. Physiologically Personalized Color Management for Motion Picture Workflows. *accepted* 2020 Annual Technical Conference of the Society of Motion Picture and Television Engineers (SMPTE).
- M. Bertalmío. Vision models for High Dynamic Range and Wide Colour Gamut imaging. Academic Press - Elsevier, 2019.
- I. Zabaleta and M. Bertalmío. In-camera, Photorealistic Style Transfer for On-set Automatic Grading. Proc. Of 2018 Annual Technical Conference of the Society of Motion Picture and Television Engineers (SMPTE).
- Sugito, Y., & Bertalmío, M. (2019, June). Practical use suggests a re-evaluation of HDR objective quality metrics. In 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX) (pp. 1-6). IEEE.
- Sugito, Y., & Bertalmío, M. (2020, May). Non-Experts or Experts? Statistical Analyses of MOS using DSIS method. In ICASSP 2020-2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 2732-2736). IEEE.
D7.5 - FL - Dissemination Showcase