Digital and Cultural Genetics

Our Virtual Mirror

There are useful similarities we can draw between our minds and the computer. One interesting connection described in the diagram above is how we relate to the world through language and society and how the computer relates to the virtual world through programming and operating systems.

The edifice of vocation is a paradigm we use to successfully interface with society. This paradigm has been generated through history in the evolution of language. In a corresponding way the computer uses specific applications to interface with the user and the virtual environment. It was generated by the evolution of programming language. Over-simplifying this in analogy could be like saying the application AutoCAD is the vocation Architect, Excel is Businessman, Photoshop is Artist, Word is Author…etc.

The level under these vocational roles is the culture that allows them to work. The equivalence here would be seeing a certain culture as a certain type of user interface. Under this we have the operating system and machine language that supports the user interface, and respectively the philosophy and semantic rigor that support our own cultural and societal interface.

Evolution

As our diagram above left suggests, this process is constantly evolving through time. Things once dreamed in previous technology become devices used to imagine newer things that are actualized in subsequent time periods.

When the perceived visceral acts and their virtual counterparts meet in time, their modes are reversed. The visceral becomes virtual, in that our waking reality systems are used to model a new virtual level. The virtual becomes visceral, in that the thing that was dreamt and fictional becomes a tangible part of our waking reality.

Breaking Barriers

How is this model related to the creative process? By comparing the way humans interact on a vocational level and how applications interact with each other we can see that the computer breaks down many of the barriers that exist between idea and its realization on the physical level. If one has a vision for an environmental design for example, the computer allows one to jump between many applications to study ideas and to get them across. If this same process was going on solely in the visceral world using older analog technologies, more practical barriers would exist between the idea, its representation and ultimately its actualization. By interacting with the world on this level, we also take part in its evolution.

Albert Vass

This is a redeveloped version of an article that first appeared at www.avass.com under “digital arts“.

Virtual Reality for Design

Origins:

It’s interesting to note that a lot of the core technologies for Virtual Reality (VR) have been around for a while. The stereoscope was invented in the early 19th century to view stereo-pairs, which is what the modern VR headsets essentially do. In fact, while waiting to get an early Cardboard headset, I rigged an old stereoscope, which you could actually focus, to use the first Google Cardboard apps. The Panorama, which is another key technology used in VR, also has a long ancestry including 19th century painted panoramas. More recently, we’ve used spherical panoramas to test architectural designs in desktop viewer apps for decades since the early days of 3D Studio Max. The real innovation in VR is the pairing of these and other previous technologies with more current ones, like the motion sensors in your phone, in an effective and economic way.

Considerations:

The quality of a VR experience depends on a variety of factors including resolution and refresh rate. Another variable is whether the experience is navigable or fixed. While their resolutions aren’t currently higher than Samsung Gear VR, headsets like the Oculus Rift and HTC Vive are more immersive because they have navigable interactivity with higher detail models.  The downside is that they need to be attached to a powerful computer to have a 3D model run in real-time. They use game engines like Unity and Unreal to create this type of interactivity. Oculus Rift and Vive can be navigated with game-pad controllers, but currently only the Vive has the ability for you to walk around a limited real space while feeling that movement in the VR environment. The Gear VR can also be navigated by a compatible game-pad and can play experiences created in game engines, but the complexity of the model is limited because it is playing off of your phone.

A fixed or moving path experience can be viewed on all headsets including the variety compatible with Google Cardboard and your smartphone. This experience is created by rendering or capturing a spherical or cubic panorama. Because they are easier to create than ones requiring game engine technology, they lend themselves better to an iterative design process. They can also often be at a higher level of detail and still work in real-time because all of the information is baked in during render or capture time. The limitation is that you cannot move around the space with a game-pad or equivalent. In many situations this is not such a problem especially if you can jump from one panoramic to another to tour an environment. These panoramas can also be rendered animations or captured videos that can walk or ride you through any environment.

VR experiences can be monoscopic or stereoscopic. The stereoscopic effect is an effective experience, but when trying to improve speed of workflow for design, a monoscopic solution can also work well. This is currently especially true for VR animations or videos where the need for two separate images to create the stereo effect actually reduces the maximum resolution (currently usually 4K) that can be played back in real-time. For VR, this size is important because you are essentially dividing that resolution by six views while looking at a magnified version of your device’s screen.

PANO-svca19-vr07

An example of a rough conceptual spherical panorama still

Virtual Reality in Architecture and Design:

VR is often used in architecture today for the marketing of architectural spaces to a client or developer. It is similar to using presentation renderings to rent or sell units for residential, retail and office spaces or to pitch concepts to communities and developers. In contrast to still renderings, the immersive quality of the VR experience allows the client or buyer to interactively feel the space. You are also surrounded by more sensory information upon which to base decisions.

Another effective application that is available today for VR is iterative design. There is a selection of VR headsets and software viewer options currently available that have a low barrier of entry. By using current design software workflows one can render immersive 360 experiences in a similar time-frame as a presentation rendering. You just have to keep in mind that because you see all around you, more of the design has to be taken into consideration and addressed. This media now adds even more value to the design model, which traditionally can also be used for study, rendering, 3D printed models and as a basis for documenting the final built form.

One can also use desktop panoramic viewers on your computer or personal device to have a semi-immersive experience without the need to go into a headset. This is often an easier way to collaborate on-screen but does not give you a convincing feeling of immersion.

By having a design team and client to experience a space under development immersively, more nuances of the space can be felt and understood. It’s also possible to toggle between and test a series of design options while standing in the same place for easy comparison. VR as a design tool lets the designer and architect have more intimate interaction with a space as its being formed, while allowing all parties involved to better understand the space’s dynamic.

We’ve recently had the pleasure of helping design a variety of innovative conceptual projects exploring things like the future of retail, long-term care facilities and even a launch control center utilizing this media as a collaborative tool. Since we can’t share these yet, below is a prior immersive VR video experience that is tied to other evolving experiments that include studies about our relationship to virtual and visceral phenomena. The easiest way to view it in Gear VR is using the Samsung VR  app where you can just search the title “Vision Machine”. For Cardboard headset related devices use the link below in your YouTube App or you can interactively watch it on your desktop. The details and narrative can be read at www.studiovass.com/2016.

Implications:

Like isometric projection, some drawing techniques in the past had portrayed abstract information about buildings in ways it would never be seen in real life. The design is often informed by these non-actual views.  Seeing a space all at once as a drawing without using a viewer, the unwrapped views of the spaces portrayed in VR may also inspire design in a similar way.

How will designing in real time VR effect the spaces we are creating? I remember seeing Timothy Leary years ago give a visionary talk about VR in college. The prop he used was a prototype VR glove. When put on and plugged in, the user’s hand was virtually interfacing with an environment depicted in the computer. It’s the predecessor to Vive’s handheld controllers, which can already allow us to draw and sculpt in VR space. Human action effecting VR  space can also be harnessed as an input device to control visceral actions perhaps via CNC machines or robots.

The science fiction idea of VR has reached the tipping point to becoming visceral. We are now enjoying the process of evolving it in our image. Actors were the natural first inhabitants of virtual spaces by being inserted into other worlds in post-production via green-screens and the like. They pretend to be in a place the viewer believes is real in cinema. In cinema, the camera looks around for you. In VR, we have to look around for ourselves. In VR, we can be immersed into feeling that the experience is equivalent to our “natural” reality. As architects and artists, we can choose to explore these new worlds within a variety of roles including designer, virtual builder and adviser.

Albert Vass