Seasonal Terrain Texture Synthesis via Köppen Periodic Conditioning

Abstract:

This paper presents the first method for synthesizing seasonal transition of terrain textures for an input heightfield. Our method reproduces a seamless transition of terrain textures according to the seasons by learning measured data on the earth using a convolutional neural network. We attribute the main seasonal texture transition to vegetation and snow, and control the texture synthesis not only with the input heightfield but also with the annual temperature and precipitation based on Köppen's climate classification as well as insolation at the location. We found that month-by-month synthesis yields incoherent transitions, while a naïve conditioning with explicit temporal information (e.g., month) degrades generalizability due to the north-south hemisphere difference. To address these issues, we introduce a simple solution -- periodic conditioning on the annual data without explicit temporal information. Our experiments reveal that our method can synthesize plausible seasonal transitions of terrain textures. We also demonstrate large-scale texture synthesis by tiling the texture output.

Keywords: Deep Learning; GAN; Texture synthesis; Terrain

Video:

Publication:

1. Toshiki Kanai, Yuki Endo and Yoshihiro Kanamori: "Seasonal Terrain Texture Synthesis via Köppen Periodic Conditioning", The Visual Computer (Proc. of Computer Graphics International 2024), 2024. [PDF(21MB)] [Slide(3MB)] [Code (Coming Soon)]

BibTeX Citation

@article{KanaiTVC2024,
      author    = {Toshiki Kanai and Yuki Endo and Yoshihiro Kanamori},
      title     = {Seasonal Terrain Texture Synthesis via K\"{o}ppen Periodic Conditioning},
      journal   = {The Visual Computer (Proc. of Computer Graphics International 2024)},
      volume    = {40},
      pages     = {4857-4868},
      year      = {2024}
    }

Last modified: July 2024