Endless Loops: Detecting and Animating Periodic Patterns in Still Images

Abstract: We present an algorithm for producing a seamless animated loop from a single image. The algorithm detects periodic structures, such as the windows of a building or the steps of a staircase, and generates a non-trivial displacement vector field that maps each segment of the structure onto a neighboring segment along a user- or auto-selected main direction of motion. This displacement field is used, together with suitable temporal and spatial smoothing, to warp the image and produce the frames of a continuous animation loop. Our cinemagraphs are created in under a second on a mobile device. Over 140,000 users downloaded our app and exported over 350,000 cinemagraphs. Moreover, we conducted two user studies that show that users prefer our method for creating surreal and structured cinemagraphs compared to more manual approaches and compared to previous methods.

@article{halperin2021endless,
  author = {Halperin, Tavi and Hakim, Hanit and Vantzos, Orestis and Hochman, Gershon and Benaim,
      Netai and Sassy, Lior and Kupchik, Michael and Bibi, Ofir and Fried, Ohad},
  title = {Endless Loops: Detecting and Animating Periodic Patterns in Still Images},
  journal = {ACM Trans. Graph.},
  issue_date = {August 2021},
  volume = {40},
  number = {4},
  month = aug,
  year = {2021},
  articleno = {142},
  numpages = {12},
  url = {https://doi.org/10.1145/3450626.3459935},
  doi = {10.1145/3450626.3459935},
  publisher = {ACM},
}