Category: project

  • 26DecAlgorithmic film assembly using toy gestures

    If you’re new here, you may want to subscribe to my RSS feed to receive the latest Architectradure’s articles in your reader or via email. Thanks for visiting!

    A new input device for video capturing and editing! Designed for young children, ages five and up, it allows them to craft compelling movies through the motion analysis of their interaction with toys.



    A child playing with Picture This and his Naruto action figure

    Continuing my research on perspective taking and tangible video editing, I recently finished the development of Picture This, a video editing and capturing device designed for young children. It allows them to craft compelling movies through the motion analysis of their interaction with toys. Children’s favorite props alternate between characters and cameramen in a film. As children play with the toys to act out a story, they conduct algorithmic film assembly.

    Picture This’s web site.

    In my prior work, Moving Pictures, I wanted to offer children the opportunity to gather imagery from their environment in the form of short video clips captured on video camera platforms modified for the application. I wanted to provide a transparent experience for the user, in which the cumbersome process of capturing and editing becomes fluid in the improvisation of a story and accessible as a way to create a final movie.

    Web site for my past work on Moving Pictures.

    Tangible interfaces combine operations on physical objects with digital data. I have sought to develop interfaces where either digital data can be overlaid onto physical objects in a display space or physical objects can act as handles into the digital space. The tangible handle is more than a marker or place-holder for digital data. It has the power to materialize and redefine our conception of space and content during the creative process.

    If the toy had a visual perspective immediately accessible to the child, a new world would be opened to her. The toy could potentially bring the child into exploring visual and narrative perspectives of these character props, expanding her discovery and understanding of social interrelationships.

    A video snippet of Picture This and a 6 minutes video for its interaction design.

    The Picture this tool is an audiovisual device that combines two digital video cameras and two accelerometers. The tool captures motions, video and sound in real-time while an algorithmic video editing system composes a movie from these inputs. A motion based editing engine fluidly assembles the film as its story is being narrated, while respecting the conventions of continuity editing, namely, a sequence of shots that appear to be continuous.

    This style of film editing is made possible in Picture This by detecting turn taking behaviors between the toys. Two toy props are augmented with video cameras and custom accelerometer hardware. They use the Picture This tool both as a doll hand-bag or a doll audiovisual recorder. The tool is flexible for a child to take the perspective of props she selected for her movie.

    Also my portfolio for selected projects is finally online!


  • 12SepInteract 2007 presentation

    If you’re new here, you may want to subscribe to my RSS feed to receive the latest Architectradure’s articles in your reader or via email. Thanks for visiting!

    Today at Interact 2007 I presented my research conducted from 2002 until 2005. I presented the story of a Graphical User Interface that became a Tangible User Interface. The presentation introduced a novel approach to collecting, editing and performing visual and sound clips in real time.

    The cumbersome process of capturing and editing becomes fluid in the improvisation of a story, and accessible as a way to create a final movie. It was shown how a graphical interface created for video production informs the design of a tangible environment that provides a spontaneous and collaborative approach to video creation, selection and sequencing.

    Iterative design process, participatory design sessions and workshop observations with 10-12 year old users from Sweden and Ireland were presented and discussed. The limitations of interfacing video capture, editing and publication in a self-contained platform were addressed.

    I uploaded my presentation in .pdf format here

    Paper in .pdf


  • 12SepInteract 2007 presentation

    If you’re new here, you may want to subscribe to my RSS feed to receive the latest Architectradure’s articles in your reader or via email. Thanks for visiting!

    Today at Interact 2007 I presented my research conducted from 2002 until 2005. I presented the story of a Graphical User Interface that became a Tangible User Interface. The presentation introduced a novel approach to collecting, editing and performing visual and sound clips in real time.

    The cumbersome process of capturing and editing becomes fluid in the improvisation of a story, and accessible as a way to create a final movie. It was shown how a graphical interface created for video production informs the design of a tangible environment that provides a spontaneous and collaborative approach to video creation, selection and sequencing.

    Iterative design process, participatory design sessions and workshop observations with 10-12 year old users from Sweden and Ireland were presented and discussed. The limitations of interfacing video capture, editing and publication in a self-contained platform were addressed.

    I uploaded my presentation in .pdf format here

    Paper in .pdf


  • 31Jul8(eight) things you probably don’t know about me–probably

    If you’re new here, you may want to subscribe to my RSS feed to receive the latest Architectradure’s articles in your reader or via email. Thanks for visiting!

    Marc Rapp the publisher of Unique Epitome has meme’d me. So here you go: 8 things you don’t know about me:

    · Some people think that I have a French accent. These people are bizarre

    · I read comic books, watch animes, and play video games. But I am not the girl of your dreams

    · I have a dark history of mathematics & economics

    · I am not vegetarian. Animals are tasty. But they are cute as pets too

    · My blog kicks ass. It always takes a while to recognize real talents

    · People constantly project on me. Stereotypes of French girls are crazy in this country. But it’s true I don’t shave and hate taking showers

    · I became very serious about my sculpture work. I had to prematurely end my brief foray because the fame was jeopardizing the work

    · I can’t find an eighth one, you know everything about me already! Here is my quiche



    My quiche Lorraine

    My turn and I will meme Architectradure’s commentors!


  • 31Jul8(eight) things you probably don’t know about me–probably

    If you’re new here, you may want to subscribe to my RSS feed to receive the latest Architectradure’s articles in your reader or via email. Thanks for visiting!

    Marc Rapp the publisher of Unique Epitome has meme’d me. So here you go: 8 things you don’t know about me:

    · Some people think that I have a French accent. These people are bizarre

    · I read comic books, watch animes, and play video games. But I am not the girl of your dreams

    · I have a dark history of mathematics & economics

    · I am not vegetarian. Animals are tasty. But they are cute as pets too

    · My blog kicks ass. It always takes a while to recognize real talents

    · People constantly project on me. Stereotypes of French girls are crazy in this country. But it’s true I don’t shave and hate taking showers

    · I became very serious about my sculpture work. I had to prematurely end my brief foray because the fame was jeopardizing the work

    · I can’t find an eighth one, you know everything about me already! Here is my quiche



    My quiche Lorraine

    My turn and I will meme Architectradure’s commentors!


  • 04DecThe ambient peacock explorer

    If you’re new here, you may want to subscribe to my RSS feed to receive the latest Architectradure’s articles in your reader or via email. Thanks for visiting!

    The Ambient Peacock Explorer

    I developed the Ambient Peacock Explorer as a framework for mobile units to document on their environment and report back to a central hub

    I believe that new work in this area can physically substantiate the documentation through tagging, the incorporation of physical communities or other conceptual redefinitions of the environment one seeks to capture.

    structure mobiles units + headquarter

    mobile units independent from the headquarter
    One shell per context of exploration. Shell inflated on top of the structure to indicate where the mobile unit is going.
    Context based shells per unit
    Water: Jelly Fish Organic Shell
    Countryside: Wooden structure
    City: Inflatable Concrete
    Air: Blimp

    headquater
    Is composed of four gathering areas: the air, the countryside, the city and the water area, a studio and an editing room. Each wall receives life feed from the mobile units based on each unit context. Environmental data from sensing mobile units are also projected on the walls as meta information. The headquarter itself retro-project on its roof the life feed of its environment and on the external walls displays the video from mobiles units. The production center also invites to discuss the documentaries and environmental issues and by that is also a showcase building.

    technology specs
    Live feed video camera from mobile units to headquarter. Each mobile unit is composed of one video camera connected via satellite to the headquarter. The life feed video camera is sent to the headquarter and projected onto the contextual area outside wall and inside wall (as part of the cafeteria gathering) area.

    Video recording and metadata from mobile units to headquarter. Each mobile unit documents by recording visual environmental elements and use sensing technologies to combine video recorded and environmental data for later post production video retrieval. For instance GPS technology for location data retrieval, temperature, wind information and so forth. The production companies will retrieve video recordings of the mobile units and metadata associated to them.

    Live feed video camera from mobile units onto mobile units. Each mobile unit would retro project their life feed footage onto their semi-transparent fabric structure to melt within its environment.

    Headquarter data exchange with mobile units. Information and request coming from headquarter to define what to explore by real time exchange video footage. Scenario: if the mobile unit is in the air and crosses a bird migration, the headquarter could visualize it and request more detailed footage or more sensing environmental data coming from the bird migration.

    communication system diagram



    visual scenario of the ambient peacock explorer



    the blimp
    the air mobile unit.
    The shell inflated on top of the structure indicates the mobile unit is going to document from above and in the air.



    the mobile unit
    common to all contexts is controlled by two people. It has real time contact with the headquarter via satellite. One person controls the mobile unit and one gathers data, exchanges information, and prepare the unit to its environmental use. The unit consists of the inflatable blimp on top, the floatation device including the organic shell at the bottom, a projector to display environmental data inside each shell.



    the mobile unit going into water.

    The compressor is used for the floatation device and an organic semi transparent shell is added around the structure. The environmental life feed video is projected on the shell. The mobile unit is waterproof.



    external view of the headquarter as a showcase.

    Four walls: the air, the countryside, the city and the water. Each wall receives life feed from the mobile units based on each unit context.

    The Ambient peacock explorer is a project I made with Philip Vriend for the Kinetic Architecture class, Assignment 2, November 2005.

    By Cati in kinetic architecture