DIP-VBTV: A Color Image Restoration Model combining a Deep Image Prior and a Vector Bundle Total Variation

  • Authors
  • Batard T, Haro G, Ballester C
  • UPF authors
  • BALLESTER NICOLAU, COLOMA; HARO ORTEGA, GLORIA;
  • Type
  • Scholarly articles
  • Journal títle
  • Journal of Imaging Science
  • Publication year
  • 2021
  • Pages
  • 1-32
  • ISSN
  • 8750-9237
  • Publication State
  • Published
  • Abstract
  • In this paper, we introduce a new variational model for color image restoration, called DIP-VBTV, which combines two priors: a deep image prior (DIP), which assumes that the restored image can be generated through a neural network and a Vector Bundle Total Variation (VBTV) which generalizes the Vectorial Total Variation (VTV) on vector bundles. VBTV is determined by a geometric triplet: a Riemannian metric on the base manifold, a covariant derivative and a metric on the vector bundle. Whereas VTV prior encourages the restored images to be piece-wise constant, VBTV prior encourages them to be piece-wise parallel with respect to a covariant derivative. For well-chosen geometric triplets, we show that the minimization of VBTV encourages the solutions of the restoration model to share some visual content with the clean image. Then, we show on experiments that DIP-VBTV benefits from this property by outperforming DIP-VTV and state-ofthe-art unsupervised methods. It demonstrates the relevance of combining DIP and VBTV priors.
  • Complete citation
  • Batard T, Haro G, Ballester C. DIP-VBTV: A Color Image Restoration Model combining a Deep Image Prior and a Vector Bundle Total Variation. Journal of Imaging Science 2021; ( ): 1-32.