CangjiePoetry.JPG
 

 

Cangjie's

         Poetry 

_仓 颉 的 诗                                                                                                                                               2020

Cangjie's Poetry is the second episode of  Cangjie  

*Compared to the last chapter, this new episode is beyond a mere visual celebration, but more importantly, a semantic human-machine experience that evokes feelings.

前 言:

Humans and machines are in constant conversations. Intelligent machines today are not only observers of the world, but they also make creative decisions. If A.I imitates human beings to generate a symbolic system and actively communicate with us based on their own understandings of the universe, to what degrees their messages and meanings will recontextualize our coexistence? 

CREDIT 

Art Direction

Visualization & Sound Design

Intelligent System Design

Creative Coding

Weidi Zhang

Intelligent System Design

Intelligent System implimentation

Donghao Ren

MEDIUM

Time Varied 

Interactive Media Art Installation

SPECIAL THANKS

Prof. Legrady and Experimental Vis Lab

 

SELECTED EXHIBITION 

AWARDS:

CANGJIE 2.0 / CANGJIE'S POETRY

SIGGRAPH ART GALLERY 2021

BEST OF SHOW AWARD

SIGGRAPH ART PAPER 2021

JOYNT ART + TECH FESTIVAL 2020

CANGJIE 1.0 / CANGJIE

JAPAN MEDIA ARTS FESTIVAL 2020

JURIED SELECTION

LUMEN PRIZE 2020

HONORABLE MENTION

SIGGRAPH ASIA ART GALLERY 2020

IEEE VIS ART PROGRAM 2020

INVITED - CHINA VIS ART GALLERY 2020

VIDEO DOCUMENTATION   [ 2 minutes ] 

 

Introduce  Cangjie's Poetry  仓 颉 的 诗 :

Cangjie’s Poetry is an intelligent multimodal system designed as a conceptual response to the future semantic human-machine reality. Inspired by an ancient Chinese legendary historian, Cangjie (c.2650 BCE), who invented Chinese characters based on the characteristics of everything on the earth, we trained a neural network that we call Cangjie, to learn the constructions and principles of over 9000 Chinese characters. After successfully training, Cangjie can interpret images through the lens of Chinese characters and produce new symbols constructed by Chinese strokes. Meanwhile, we implement a pre-trained model to simultaneously generate localized descriptive sentences of images in natural language to create meanings for this symbolic system.

In the art installation, the Cangjie system captures surroundings using a camera and transforms the real world streaming into a cluster of ever-changing new symbols in real-time. Those novel symbols made of Chinese strokes tangled with the imagery captured by the camera in the installation are visualized algorithmically as an abstract pixelated landscape. The landscape dynamically moves, evolves, and writes poetry based on the image data of the live streaming captured by the camera. We project the visualization of the semantic landscape on the wall in the exhibition space as the first projection. In the meantime, Cangjie also generates descriptive sentences of surroundings based on its interpretation. Those sentences are designed as flowing poetry written in ink, assembled with real-time captured imagery fragments as the second projection in the space.

Visualization I   Cangjie writes poetry using pixels of live streaming textures, 2020. (© Weidi Zhang)

shi.jpg

Visualization II  Cangjie describes surroundings as a visual form of poetry. (© Weidi Zhang)

mainImage.jpg