Deep Colorization

A curated list of awesome resources for colorization. We will keep updating it.

❗ Updated 2022-07.

---

Content:

• Preprint
• Papers of 2015 to Present
• Colorization Others
• Appendix

---

Preprint

Year	Pub.	Title	Links
2021	arXiv08	Towards Photorealistic Colorization by Imagination Chenyang Lei, Yue Wu, Qifeng Chen	Paper/Code
2021	arXiv07	Attention-Guided NIR Image Colorization via Adaptive Fusion of Semantic and Texture Clues Xingxing Yang, Jie Chen, Zaifeng Yang, et al.	Paper/Code
2021	arXiv06	Color2Embed: Fast Exemplar-Based Image Colorization using Color Embeddings Hengyuan Zhao, Wenhao Wu, et al.	Paper/Code
2020	arXiv08	Image Colorization: A Survey and Dataset Saeed Anwar, et al.	Paper/Code

2023

Year	Pub.	Title	Links
2023	SA	Diffusing Colors: Image Colorization with Text Guided Diffusion Nir Zabari, Aharon Azulay, Alexey Gorkor, Tavi Halperin, Ohad Fried	Paper/Code
2023	ICCV	Sketch and Text Guided Diffusion Model for Colored Point Cloud Generation Zijie Wu, Yaonan Wang, Mingtao Feng, He Xie, Ajmal Mian	Paper/Code
2023	ICCV	DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders Xiaoyang Kang, Tao Yang, Wenqi Ouyang, Peiran Ren, Lingzhi Li, Xuansong Xie	Paper/Code
2023	ICRA	Scene-level Point Cloud Colorization with Semantic-and-Geometric-aware Networks Rongrong Gao, Tian-Zhu Xiang, Chenyang Lei, Jaesik Park, Qifeng Chen	Paper/Code

2022

Year	Pub.	Title	Links
2022	ECCV	Bridging the Domain Gap towards Generalization in Automatic Colorization Hyejin Lee, Deahee Kim, DaEun Lee, Jinkyu Kim, Jaekoo Lee	Paper/Code
2022	ECCV	BigColor: Colorization using a Generative Color Prior for Natural Images Geonung Kim, Kyoungkook Kang, Seongtae Kim, Hwayoon Lee, et al.	Paper/Proj/ Code
2022	ECCV	ColorFormer: Image Colorization via Color Memory assisted Hybrid-attention Transformer X. Ji, B. Jiang, D. Luo, G. Tao, et al.	Paper/Code
2022	ECCV	CT2: Coloriztation Transformer via Color Tokens Shuchen Weng, Boxin Shi, et al.	Paper/Code
2022	CVPR	Style-Structure Disentangled Features and Normalizing Flows for Diverse Icon Colorization Yuan-Kui Li, Yu-Shuen Wang, et al.	Paper/Code
2022	SIGGRAPH	Palette: Image-to-Image Diffusion Models Chitwan Saharia, William Chan, Huiwen Chang, Chris A Lee, Jonathan Ho, Tim Salimans, et al.	Paper/Code
2022	AAAI	SCSNet: An Efficient Paradigm for Learning Simultaneously Image Colorization and Super-Resolution Jiangning Zhang, et al.	Paper/Code
2022	AAAI	L-CoDe: Language-based Colorization using Color-object Decoupled Conditions Shuchen Weng, Hao Wu, et al	Paper/Code
2022	EAAI	Deep learning for image colorization: Current and future prospects Shanshan Huang, Xin Jin, Qian Jiang, Li Liu	Paper/Code

2021

Year	Pub.	Title	Links
2021	ICCV	Deep Edge-Aware Interactive Colorization Against Color-Bleeding Effects E. Kim, S. Lee, J. Park, et al.	Paper/Proj
2021	ICCV	Towards Vivid and Diverse Image Colorization with Generative Color Prior Yanze Wu, et al.	Paper/Code
2021	MM	Yes, 'Attention Is All You Need', for Exemplar based Colorization Wang Yin, et al.	Paper/Code
2021	MM	Focusing on Persons: Colorizing Old Images Learning from Modern Historical Movies   Xin Jin, Dongqing Zou, et al.	Paper/Data
2021	CVPR	User-Guided Line Art Flat Filling with Split Filling Mechanism Lvmin Zhang, Tien-Tsin Wong, et al.	Paper/Proj
2021	CVPR	HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms M. Afifi, M. Brubaker, Michael S. Brown	Paper/Code
2021	ICLR	Colorization Transformer M. Kumar, D. Weissenborn, Nal Kalchbrenner	Paper/Code
2021	TIP	Self-Supervised Colorization Towards Monochrome-Color Camera Systems Using Cycle CNN Xuan Dong, Yunhong Wang, et al.	Paper/Code
2021	TIP	Dual Color Space Guided Sketch Colorization Zhi Dou, et al.	Paper/Code
2021	TVCG	A Colorization Framework for Monochrome-Color Dual-Lens Systems using a Deep Convolutional Network Xuan Dong, Yunhong Wang, et al.	Paper/Code
2021	TVCG	Interactive Deep Colorization and Its Application for Image Compression Yi Xiao, et al.	Paper/Code
2021	TVCG	Palettailor: Discriminable Colorization for Categorical Data Kecheng Lu, et al.	Paper/Code
2021	TNNLS	Broad Colorization Yuxi Jin, et al.	Paper/Code
2021	TMM	VCGAN: Video Colorization with Hybrid Generative Adversarial Network Yuzhi Zhao, et al.	arXiv/Code

2020

Year	Pub.	Title	Links
2020	MM	Gray2ColorNet: Transfer More Colors from Reference Image Peng Lu, et al.	Paper/Code SUPP
2020	ECCV	Learn to Recover Visible Color for Video Surveillance in a Day G. Wu, Yinqiang Zheng, et al.	Paper/Code
2020	ECCV	Colorization of Depth Map via Disentanglement Chung-Sheng Lai, et al.	Paper/Code
2020	CVPR	ColorFool: Semantic Adversarial Colorization Ali Shahin Shamsabadi et al.	Paper/Code
2020	CVPR	Instance-Aware Image Colorization J. Su, H. Chu, Jia-Bin Huang	Paper/Code Proj
2020	CVPR	Stylization-Based Architecture for Fast Deep Exemplar Colorization Zhongyou Xu, et al.	Paper/Code
2020	CVPR	Reference-Based Sketch Image Colorization Using Augmented-Self Reference and Dense Semantic Correspondence Junsoo Lee, et al.	Paper/Code Proj
2020	AAAI	Cycle-CNN for Colorization towards Real Monochrome-Color Camera Systems  Xuan Dong, Yunhong Wang, et al.	Paper/Code
2020	IJCV	Pixelated Semantic Colorization Jiaojiao Zhao, Jungong Han, et al.	Paper/Code
2020	TVCG	A Superpixel-Based Variational Model for Image Colorization Faming Fang, Guixu Zhang, et al.	Paper/Code
2020	TVCG	Active Colorization for Cartoon Line Drawings Shu-Yu Chen, et al.	Paper/Code
2020	TMM	Automated Colorization of a Grayscale Image With Seed Points Propagation Shaohua Wan, et al.	Paper/Code
2020	TSCVT	SCGAN: Saliency Map-guided Colorization with Generative Adversarial Network Yuzhi Zhao, et al.	arXiv/Code

2019

Year	Pub.	Title	Links
2019	SIGA	DeepRemaster: temporal source-reference attention networks for comprehensive video enhancement Satoshi Iizuka, Edgar Simo-Serra	Paper/Code Proj
2019	SIGA	Language-based Colorization of Scene Sketches Changqing Zou, Haoran Mo, et al.	Paper/Code/ Proj
2019	ICCV	Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss Hyunsu Kim, et al.	Paper/Code
2019	MM	Adversarial Colorization of Icons based on Contour and Color Conditions Tsai-Ho Sun, Chien-Hsun Lai, et al.	Paper/Code
2019	CVPR	Fully Automatic Video Colorization With Self-Regularization and Diversity Chenyang Lei, Qifeng Chen, et al.	Paper/Code Proj
2019	CVPR	Deep Exemplar-Based Video Colorization Bo Zhang, et al.	Paper/Code
2019	CVPR	Coloring With Limited Data: Few-Shot Colorization via Memory Augmented Networks Seungjoo Yoo, et al.	Paper/Code Proj
2019	CVPRW	Image Colorization by Capsule Networks Gokhan Ozbulak	Paper/Code
2019	CVPRW	Robust Image Colorization Using Self Attention Based Progressive Generative Adversarial Network Manoj Sharma, et al.	Paper/Code
2019	AAAI	Learning a Deep Convolutional Network for Colorization in Monochrome-Color Dual-Lens System  Xuan Dong, Yunhong Wang, et al.	Paper/Code
2019	TIP	Automatic Example-Based Image Colorization Using Location-Aware Cross-Scale Matching Bo Li, Yu-Kun Lai, et al.	Paper/Code
2019	CGF	Example-Based Colourization Via Dense Encoding Pyramids Chufeng Xiao, Tien-Tsin Wong, et al.	Paper/Code

2018

Year	Pub.	Title	Links
2018	ECCV	Tracking Emerges by Colorizing Videos Carl Vondrick, et al.	Paper/Code
2018	ECCV	Coloring with Words: Guiding Image Colorization Through Text-based Palette Generation Hyojin Bahng, Seungjoo Yoo, et al.	Paper/Code
2018	ECCV	Structural Consistency and Controllability for Diverse Colorization Safa Messaoud, David Forsyth, et al.	Paper/Code
2018	ECCV	Switchable Temporal Propagation Network Sifei Liu, Ming-Hsuan Yang, et al.	Paper/Code
2018	MM	User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks Yuanzheng Ci, et al.	Paper/Code
2018	SIG	Deep Exemplar-based Colorization Mingming He, Lu Yuan, et al.	Paper/Code
2018	SIG	Progressive Color Transfer with Dense Semantic Correspondences Mingming He, Lu Yuan, et al.	Paper/Code
2018	SIGA	Two-stage sketch colorization Lvmin Zhang, Tien-Tsin Wong, et al.	Paper/Proj
2018	AAAI	Learning Generative Neural Networks for 3D Colorization              Z. Yang, L. Liu, Qixing Huang	Paper/Codee
2018	TVCG	A Data-Driven Approach for Furniture and Indoor Scene Colorization Jie Zhu, Yanwen Guo, Han Ma	Paper/Code

2017

Year	Pub.	Title	Links
2017	CVPR	Learning Diverse Image Colorization Aditya Deshpande, David Forsyth, et al.	Paper/Code
2017	CVPR	Colorization as a Proxy Task for Visual Understanding Gustav Larsson, Michael Maire, et al.	Paper/Code Proj
2017	CVPR	Image-to-Image Translation with Conditional Adversarial Networks  P. Isola, Jun-Yan Zhu, et al.	Paper/Code
2017	CVPR	Generalized Deep Image to Image Regression V. Santhanam, Vlad I. Morariu, Larry S. Davis	Paper/Code
2017	CVPR	Scribbler: Controlling Deep Image Synthesis with Sketch and Color Patsorn Sangkloy, Fisher Yu, et al.	Paper/Code
2017	CVPR	Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Prediction Richard Zhang, Phillip Isola, Alexei A. Efros	Paper/Code Proj
2017	SIG	Real-Time User-Guided Image Colorization with Learned Deep Priors Richard Zhang, Jun-Yan Zhu, et al.	Paper/Code Proj
2017	TIP	Colorization Using Neural Network Ensemble Z. Cheng, Q. Yang, Bin Sheng	Paper/Code

2016

Year	Pub.	Title	Links
2016	ECCV	Colorful Image Colorization Richard Zhang, Phillip Isola, Alexei A. Efros	Paper/Code Proj
2016	ECCV	Learning Representations for Automatic Colorization G. Larsson, M. Maire, and G. Shakhnarovich	Paper/Code Proj
2016	SIG	Let there be Color! Joint End-to-end Learning of Global and Local Image Priors for Automatic Image Colorization with Simultaneous Classification   Satoshi Iizuka, Edgar Simo-Serra Hiroshi Ishikawa	Paper/Code Proj

2015

Year	Pub.	Title	Links
2015	ICCV	Learning Large-Scale Automatic Image Colorization A. Deshpande, J. Rock, David Forsyth	Paper/Code Proj
2015	ICCV	Depth Map Estimation and Colorization of Anaglyph Images Using Local Color Prior and Reverse Intensity Distribution   Williem, Ramesh Raskar, In Kyu Park	Paper/Code
2015	ICCV	Deep Colorization Z. Cheng, Q. Yang, Bin Sheng	Paper/Code Ext

Colorization Others

Year	Pub.	Title	Links
2017	ICCV	CycleGAN: Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks Jun-Yan Zhu, T. Park, P. Isola, Alexei A. Efros	Paper/Code Proj
2017	CVPR	Pix2Pix: Image-to-Image Translation with Conditional Adversarial Nets  P. Isola, Jun-Yan Zhu, T. Zhou, Alexei A. Efros	Paper/Code Proj

Appendix

• Open Source Softerware: DeOldify
• Online Line Drawing Colorizer : Petalica Paint, PaintsChainer
• Awesome Image Colorization