aiculedssul

AI Art Projects and Workshops by Artem Konevskikh

Reality Capture: Bridging the gap between physical and virtual

–
Institution: Art&Science Master Programme at ITMO University (Saint-Petersburg, Russia)
Team: Marina Muzyka, Artem Konevskikh
Keywords: 2022, 3d scanning, ai, art, course, generative ai, itmo, machine learning, neural networks, photogrammetry, volumetric ai, vr

The New Space, produced by the layers of autonomy, forces the present to form a hybrid interwoven structure through the augmentation of our physical reality. This physical reality is no longer the base for superstructure “virtual”, but the synergetic form of metareal.

The metareal is still a dichotomy of analog and digital, producing new types of materiality. This materiality can be represented through absorbed information processes that give rise to new spatial experiences. However, despite the existence of this dichotomy, the boundary between analog and digital in this case ceases to exist as a tangible substance.

Being the synergetic hybrid, the dichotomy of analog and digital can be explored through the medium: 3D reconstruction and photogrammetry. In this case, the technology gives the device the privilege to become a sensor for consumption and reality. The technology allows transferring informational material, which produces a narrative of augmented space.

Schedule

  • Day 01_ONLINE / 19.04.2022 - 11am
    • 1.5 hours - Photogrammetry Lecture and Tutorial - Introduction to photogrammetry and 3d scanning techniques. How it works. Which devices we can use. Best practices
    • 1.5 hours - Mobile photogrammetry - Shooting and reconstructing with the mobile phones
  • Day 02_OFFLINE / 20.04.2022 - 11am
    • 3 hours - Shooting session - An on-site shooting session to digitize the environment. Capturing the landscape with our cameras and phones to create the digital copy of the site.
  • Day 03_ONLINE / 21.04.2022 - 11am
    • 1.5 hours - Environment reconstruction - Working with open-source photogrammetry software tools (Meshroom/Colmap/Regard3D) to reconstruct captured environments. (maybe two sessions - one to show the tools, another to check the results?)
    • 3 hours - Work in Progress
  • Day 04_OFFLINE / 22.04.2022 - 11am
    • 1.5 hours - Review + Reading Group
  • Day 05_OFFLINE / 25.04.2022 - 11am
    • 1.5 hours - Review (Scans+Concepts)
    • 1.5 hours - Blender Workflow /Scans' Optimization_INTRO / Scene Editing - Task: create a board, with a series of experiments/search for a specific estetics
  • Day 06_OFFLINE / 26.04.2022 - 11am
    • 1.5 hours - Blender Workflow /Scans' Optimization Groupwork / Work in Progress - Task: combine an own estetics with the concept
  • Day 07_ONLINE / 27.04.2022 - 11am
    • 3 hours - Neural networks and 3D reconstruction - Using neural networks for human body reconstruction
  • Day 08_ONLINE / 28.04.2022 - 3pm
    • 3 hours - Neural Rendering - Reconstructing and rendering the environments with the neural networks.
  • Day 09_OFFLINE / 29.04.2022 - 11am
    • 1.5 hours - Mozilla Scene Editing
    • 1.5 hours - Scene Composition in Mozilla
    • 1.5 hours - FINAL REHEARSAL - Task: prepare the final presentation
  • Day 10_ONLINE / 30.04.2022 - 11am
    • 3 hours - PRESENTATIONS: Mozilla Hubs Rooms + pptx (artboards, concepts)