JPEG Pleno: providing representation interoperability for holographic applications and devices

Guaranteeing interoperability between devices and applications is the core role ofstandards organizations. Since its first JPEG standard in 1992, the Joint Photo-graphic Experts Group (JPEG) has published several image coding standards thathave been successful in a plethora of imaging markets. Recently, these marketshave become subject to potentially disruptive innovations owing to the rise ofnew imaging modalities such as light fields, point clouds, and holography. Theseso-called plenoptic modalities hold the promise of facilitating a more efficient andcomplete representation of 3D scenes when compared to classic 2D modalities.However, due to the heterogeneity of plenoptic products that will hit the market,serious interoperability concerns have arisen. In this paper, we particularly focuson the holographic modality and outline how the JPEG committee has addressedthese tremendous challenges. We discuss the main use cases and provide a pre-liminary list of requirements. In addition, based on the discussion of real-valuedand complex data representations, we elaborate on potential coding technologiesthat range from approaches utilizing classical 2D coding technologies to holo-graphic content-aware coding solutions. Finally, we address the problem of visualquality assessment of holographic data covering both visual quality metrics andsubjective assessment methodologies.