RESEARCH | Weidi :: Media Arts

Weidi Zhang’s Ph.D Qualifying Exam

Committees

Prof. George Legrady (chair)
Prof Marko Peljan
Prof Curtis Roads

Keywords

Spatial data visualization
Image-classification algorithms
Non-linear narrative
Immersive experience 【 audio-visual interactive 】

Research Statement

Collage is an artistic technique for artists to assemble different pictorial motifs, forms, materials into new entities which often suggest non-linear narratives, poetic meanings, and new symbols. The ideas and methods of collage art production widely emerged in the twentieth century in the early stage of modernism and were closely involved in modern art movements like Cubism, Surrealism, and Dada.

While image manipulation methods (including collage, photomontage and mixed media) have been present in the art world for a long time, computational photography and image classification algorithms (including convolutional neural network (CNN) borrowed from the field of engineering) enable artists to conceive new directions by reconsidering the process of collage. This can be accomplished by embracing Surrealist chance operations and mechanisms of poetic choice and by re-examining the automatism of the Surrealists and Abstract Expressionists in the context of current and emerging A.I. age.

Oliver Grau mentioned in his book Virtual Art: From Illusion to Immersion that the creation of an artificial immersive virtual reality, arising as a result of technical exploitation of new inventions, is a long-standing human practice throughout history. Such environments as dioramas were made of composited images.

The technology of virtual reality enables a great many possibilities for spatial assemblage. The booming market of the entertainment industry makes virtual reality a commercial platform for gaming and 360 films. VR art is still an area under development although it has been 25 years since the exhibition of first VR art piece Osmose (1995).

I came up with the following questions:

How do we embrace the chances and choices in relation to the subconscious in the collage-making progress?
If the real world is a collage, how about the virtual one?
How can we transfer the image-making process into world-building strategies in order to experience images as an ever-expanding territory?

Thus my research will focus on the development of an intelligent algorithmic system that investigates the possibilities of non-linear narrativity and semantic meanings through spatial collage of images in virtual reality environments. The tentative methodology of the research for the algorithmic spatial assemblage of images for VR world-building will include:

The development of data-driven image processing methods
Image classification algorithms (including convolutional neural network CNN),
Virtual reality world-building strategies and techniques
3-d modeling techniques: including 3-d image-based structure generation/photogrammetry/ visualization of point cloud
spatial sound development.