- Exploration of Physical and Virtual Space -

New Website

2009-01-08T22:50:00.001-08:00

I am moving documentation to a new website - address coming soon.

Demos

2008-12-14T17:16:00.000-08:00

Here are three demos of the concepts which I would like to develop in the future.

Sickness

Captain Planet

Group Painting

The Future

2008-12-03T09:22:00.000-08:00

Here are some outlines of ideas which I intend to develop in the future of the project.

Captain Planet

I was inspired by the cartoon show Captain Planet - I wonder why it ended and isn't around now to help fight global warming. Anyways the field displays a world covered in pollution. The players have the power to clear the pollution - they act like erasers on the screen. However their efforts do not last long and the pollution returns. Separately each of the player's efforts dont' seem to do much however "With your powers combined" they can create a larger and more permanent eraser. The idea is to get the people in the space to put aside their personal space for a more important cause.

The color these images is funky. Currently the space is just covered with rectangular images of pollution, in the future I intend to change how I present "pollution". I also hope to apply this idea to other issues such as sexually transmitted diseases or UCSD.

Magnetism

In this concept, each person has an influence over an object. The object is presumably something that the group needs to protect or transport somewhere. As the team moves across the terrain at times certain people will have more influence over the object. For example when the green figure is over the green area it will have a stronger pull. Enemies will appear and the team will have to coordinate in order to avoid disaster. The idea here is to acknowledge that different people have different strengths and that the team must communicate/coordinate to protect a target/goal. Culturally it shows that in group dynamics there are often times people who are more dominant and those who are less involved, and rarely is there an equality among all members of the group.

I want to work on the overall visual aesthetics of the project. Currently the backgrounds and such are somewhat crude. However, I choose the pedestrian silhouette to represent the players because it is a symbol of physical movement rather than machine mediated movement.

Sickness

2008-12-03T08:53:00.000-08:00

I was somewhat inspired after catching two colds/flus this quarter. After thinking about the hide and seek game and toying with it some more I realized that actually playing it is somewhat boring. I've modified the hide and seek game to behave more like a sickness.

We come into contact with people everyday not knowing what kinds of sickness they may carry. How would people behave if they knew the health status of people around them? Today people with HIV or AIDS constantly wonder about how people would react if others knew about the disease. Sometimes people try to keep away from other persons who are presenting symptoms of a cold.

The hidden object in the field is silent. However when a person comes into contact they "catch" it. As the person moves around the field and comes into contact with other people there is a chance that the other person will also "catch" the object. However if the other person "catches" the object then the original person will "recover". Also there is a chance that the object may leave the original host without any notice. Other players will be alerted if they come close to "infected" person via vibration.

In this demo the "sickness" behavior is portrayed as a game of tag where nobody knows who is it until it may be too late!

Ideas

2008-11-11T22:04:00.001-08:00

After last weeks discussion, the project is taking a new direction. Basically I would like to use a downward projection onto the floor, and multiple wiimotes to explore the dynamic physical/virtual/cultural relationships in space. I also did a little bit of research looking for projects which involve some kind of spatial physical exploration:

http://www.camilleutterback.com/arctangent.html

http://www.youtube.com/watch?v=FHXw1niqvPs

Ameoba
- utilizes a couple of participants to form the body and moving appendages of an Ameoba.
- the remaining people become paramecium or prey of the ameoba
- the people making up the amoeba have to work together to ensnare the prey
- when captured, prey become part of the ameoba
- this increases the number of people and also the amount of cooperation needed

Snowflakes
- I was inspired by a video game which helped you see your targets by superimposing virtual lines of sight to your target
- while people move around in the space, lines are drawn connecting each person
- the resulting pattern is then used to create snowflakes representing the unique, ephemeral, and dynamic physical relationships between people
- allows groups of people to create an artist representation of themselves, kind of like a logo or something
- similar (maybe too similar) to arctangent

Hide & Seek
- there is a hidden something in the environment (what it is and what happens if found I don't know yet)
- this hidden thing at first is stationary
- it emits shockwaves
- like ripples on water, as the waves travel though the environment they can be felt by people wearing the wiimote
- the people in the environment must collaborate in order to locate the source of the shockwaves
- the "net" of people become a kind of radar detection
- however the hidden something may move when it seems like it may be found
- may want to include audio as well

some thoughts

2008-11-02T13:29:00.000-08:00

after wednesdays discussion I feel that using the wiistrap on and wii butt, while having some shock value, don't really bring a lot of intellectual thought to the project. They are very literal interpretations of the penis and may come off as sexist. Also while sexual body language might be a new way to interface with the virtual world I would like to find another way to use the wiimote capabilities.

Halloween

2008-10-31T08:30:00.000-07:00

Here is an updated list of links to wiimote+pc information:

http://wiiflash.bytearray.org/

- the wiiflash website is about connecting the wiimote to flash. they do it through the use of an api and a server - this method works pretty well and I am currently using it for my project, caveats would be that it requires adobe flash 9 and above and learning actionscript3

http://wiimote.chloefan.net/wiimote.html

- this is a helpful site that utilizes the wiiflash.org way of connecting the wiimote to your pc and creating programs using adobe flash and actionscript3

http://www.wiicade.com/

- this site is for developing flash games for the wii

http://www.wiili.org/forum/

- the wiili.org forums have a lot of information on how to connect the wiimote to the pc and information on how to get started using GlovePie, a scripting program which works well with the wiimote

Whats it gonna look like?

2008-10-29T12:08:00.000-07:00

I've been thinking a little bit about how I want the end product to look like and function. Ideally I would have a projection in a public place or a gallery on to a wall or a ceiling. Visitors/guests/participants/players whatever one wants to call them would wear special wiimote equipped apparatuses. The strap-on wiimote and the buttplug wiimote respectively.

The projected content would be some kind of arousing imagery displayed through Flash. The wiimotes will connect to Flash and be represented by icons (maybe hands?). Moving the wiimotes will move the icons. Initially the movie will be paused. There will be another set of icons displaying motions on the screen, overlayed on certain parts of the movie. In order to move forward in the movie players will have to match the motions displayed on screen by moving their bodies. In a way the participants become physical actors of the virtual content being displayed. If the arousing content displayed includes more than two actors then an equal amount of participants will be needed in order to continue the movie.

Debuggin

2008-10-28T21:20:00.001-07:00

Have been trying to get the wiimote to work with flash for the past couple of hours. No success.

First attempt to get Flash to work with wiimote.
- software - flash 8
- wiimote
- method - labs.wiicade.com

I followed the instructions on the website: downloaded the api, placed it in the correct folder, created new flash document and added necessary code to connect the wiimote and flash. Tried the test swf file and got no response from the wiimote. I tested the bluetooth connection with glovepie and everything was fine there. I tried debugging the code and looking though the forums for troubleshooting but didn't find much help.

Second attempt to get Flash to work with wiimote.
- software - flash 8
- wiimote
- method - wiiflash.org

Downloaded the wiiflash server and network support for windows. All installed properly. Got the wiiflash server to detect the wiimote - everything is connected properly. Attempted to open the demo files and discovered that I need flash 9 and above to work.

Third attempt to get Flash to work with wiimote.
- software - flash 8 (hoping to get flash 9 or above sometime)
- wiimote
- ppjoy
- method - try to convert wiimote to joystick and connect joystick to flash.

This attempt is currently in progress

Flash

2008-10-21T17:48:00.003-07:00

Trying to figure out how to connect the wiimote to flash. Came across a site called wiiflash.org which uses a server to work with flash I think. I downloaded the programs and got the wiimotes to connect to the server but I haven't figured out how to do anything with it. Currently I am creating an experimental game in flash that has users track movements in order to keep progressing.

Wii Scripts and Wii x2

2008-10-20T12:06:00.001-07:00

Working on getting different scripts to run on the wiimote, ran into a potential problem when trying to get the right bluetooth stack/drivers. The bluetooth stack which comes with the dongle I purchased doesn't really work with the wiimote. Downloaded a trial version of BlueSoleil which does work with the wiimote, however it stops working after transmiting 2mb of data :(

Found a script for connecting two wiimotes and am looking into how to get that to work. May also be experimenting with the nunchuck attachment. Currently I am using this script (which came with the glovepie program) to use the wiimote as a mouse:

//WiiMouse Version 0.1
//www.wiiscript.co.nr
//Based upon Unplayable BF2 Control Script by Duke4ever

//WiiMouse 0.1
//Created by WiiScript.co.nr

//Ive came up with a mouse script that works really well! I hope you enjoy my script and if you have
//any ideas or problems please email me at sbraidley@yahoo.co.uk

//Instructions:
//A = Right Click
//B = Left Click
//Plus = Enter
//Home = Stop Script / Pressed twice close GlovePie
//Minus = Backspace
//1 = My Computer
//2 = Internet

//Please visit the website to check for updates
//www.wiiscript.co.nr

if Wiimote.home
if doubleclicked(Wiimote.home)
ExitPie
else
wait 200 ms
ExitProgram
endif
endif
var.trimx = 2
var.trimy = -26
var.trimz = 1

Up = wiimote.Up
Down = wiimote.Down
Left = wiimote.Left
Right = wiimote.Right

Mouse.RightButton = Wiimote.A

Mouse.LeftButton = Wiimote.B

Key.enter = wiimote.plus

Key.mycomputer = wiimote.One

Key.internet = wiimote.Two

Key.backspace = wiimote.minus

if 0 = 0 then
if var.kitt = 0 then
wiimote.Leds = 1

endif
if var.kitt = 1 then
wiimote.Leds = 3
endif
if var.kitt = 2 then
wiimote.Leds = 6
endif
if var.kitt = 3 then
wiimote.Leds = 12
endif
if var.kitt = 4 then
wiimote.Leds = 8
//wait 200 ms
endif
if var.kitt = 5 then
wiimote.Leds = 12
endif
if var.kitt = 6 then
wiimote.Leds = 6
endif
if var.kitt = 7 then
wiimote.Leds = 3
endif
wait 100 ms
var.kitt = (var.kitt + 1) % 8
endif

if Wiimote.B then
if var.rmbl = false
wiimote.Rumble = 1
wait 50 ms
wiimote.Rumble = 0
endif
var.rmbl = true
else
var.rmbl = false
endif

var.x = Wiimote.RawForceX + var.trimx
var.y = Wiimote.RawForceY + var.trimy
var.z = Wiimote.RawForceZ + var.trimz

var.sense0 = 1000
var.thresh0x = 2
var.thresh0y = 1

var.sense = 300
var.threshx = 10
var.threshy = 5

var.sense2 = 100
var.thresh2x = 15
var.thresh2y = 8

var.sense3 = 50
var.thresh3x = 20
var.thresh3y = 12

if var.x > var.thresh0x
mouse.x = mouse.x - 1/var.sense0
endif
if var.x < -var.thresh0x
mouse.x = mouse.x + 1/var.sense0
endif

if var.z > var.thresh0y
mouse.y = mouse.y - 1/var.sense0
endif
if var.z < -var.thresh0y
mouse.y = mouse.y + 1/var.sense0
endif

if var.x > var.threshx
mouse.x = mouse.x - 1/var.sense
endif
if var.x < -var.threshx
mouse.x = mouse.x + 1/var.sense
endif

if var.z > var.threshy
mouse.y = mouse.y - 1/var.sense
endif
if var.z < -var.threshy
mouse.y = mouse.y + 1/var.sense
endif

if var.x > var.thresh2x
mouse.x = mouse.x - 1/var.sense2
endif
if var.x < -var.thresh2x
mouse.x = mouse.x + 1/var.sense2
endif

//yaxis
if var.z > var.thresh2y
mouse.y = mouse.y - 1/var.sense2
endif
if var.z < -var.thresh2y
mouse.y = mouse.y + 1/var.sense2
endif

if var.x > var.thresh3x
mouse.x = mouse.x - 1/var.sense3
endif
if var.x < -var.thresh3x
mouse.x = mouse.x + 1/var.sense3
endif

if var.z > var.thresh3y
mouse.y = mouse.y - 1/var.sense3
endif
if var.z < -var.thresh3y
mouse.y = mouse.y + 1/var.sense3
endif

debug = var.x + " " + var.y + " " + var.z

I don't completely understand the code yet. So I am trying to learn how to program the wiimote enough so that I can use two wiimotes and have two cursors etc for a collaborative project.

Input Options

2008-10-15T04:14:00.000-07:00

I've been researching different motion sensing options for the project. The first option that came to mind was the wii remote.

I looked at Johnny Lee's work using the wiimote to finger movements and head tracking.
http://www.cs.cmu.edu/~johnny/projects/wii/
Many of his projects used C# and other programs.

This is a forum website I came across with lots of info on connecting the wiimote to connect to the pc as well as programs to use wiimote input.
http://www.wiimoteproject.com/

This is a Japanese website that has written a program to use the wiimote and the PS3 six axis controller with a pc
onakasuita.org

Here is another resource in wiki form.
http://www.wiili.org/index.php/Main_Page

While at Fry's electronics looking for bluetooth dongle's and wiimote accessories I came across this mouse which is like the wiimote in the sense that it has motion tracking capabilities. This would make connecting to the pc a lot easier however it is also expensive and probably has less creative development from hackers than the wiimote right now.
http://www.yankodesign.com/2008/09/22/logitechs-mx-air-wants-to-fly/

A Possible Project

2008-10-08T12:24:00.000-07:00

Based on the ideas from the previous post I would propose creating an installation type of project set in a public space which asks people to use their bodies to navigate a gui to do social networking or collaborative actions. Here are the parts to the project:

Body based pointing device - most likely I will use some kind of motion tracking device with accelerometers, maybe a wiimote and have it attached to the body in some way. The wearer will have to do physical actions in order to do virtual or computation actions.

Display - I want the display to be for an audience rather than a single person, also I feel that projecting onto a surface is more versatile than using a monitor.

Software - most likely I will use Flash to program the connections between the body based pointing device and the gui/display. Also I will need to program the inputs and how to interpret the body language of the users.

Setting - a public arena, maybe the new Price Center or the wall of a residence hall a place where people will encounter and be confronted by the art. I want to get away from the private physicality of computing. I want to bring the openess of the virtual world to the physical side. However one obstacle maybe trying to get people to participate, online people feel protected from the safety of their homes and the facade of an avatar or screen name, in public that all goes away.

3 Main Ideas

2008-10-08T08:38:00.000-07:00

Today computers are shrinking and reaching new areas of our lives. However, the majority of us probably still sit at a desktop computer and use a keyboard, mouse and monitor. This type of computing interface practically isolates and immobilizes our physical bodies. Today many of our body's functions have been taken over by the perspective of the machine. We use computers to view and explore the world, cars to travel, ipods to hear and so on. Our experience of the world is increasingly mediated by computers.

In a world where everything occurs through the use of machines, our bodies become increasingly obsolete. For example take transportation, most people in San Diego own a car and drive to any given destination; students living on campus will even drive a minimal distance to visit a friends dorm instead of walking. Cars have become the new bionic legs and arms of people today. Not having a car is like being physically handicapped. If one takes the bus or other commuting alternatives it is still a handicap - public transportation is the equivalent of dial up internet while private transport by car is more like typical isp service.

Another issue I would like to address in this project is the use of alternative interfaces. The touchscreen interface has been getting fairly popular with many portable devices implementing software gui that utilize this function. I feel like this is a step in the direction of moving away from the mouse and keyboard setup. However most touch screen interfaces only exercise the fingers. By having the user perform more physical activity, I hope to bring a sense of appreciation for all the work computers do for us and further breakdown traditional notions of interface. My inspiration for an alternative interface is ASL (American Sign Language). ASL utilizes the body's constraints and affordances to create a language composed of from the different forms one can make with their body and face. Its an utterly "human" language. Often times the metaphor for a "command line interface" is like giving out speech commands and having to explicitly describe all the actions. ASL brings a physicality to the navigation of a gui.

Finally the third issue I would like to address with the project is the private and public aspects of computing. Using the computer is mostly a personal affair, whether one is on a laptop in class or at home in the comfort of their home. Like the cell phone the desktop/laptop computer is a personal device - millions of people look at porn every day - this is possible due to the private nature of using a computer. This private nature often isolates one physically, however on the flip side - access to a computer is quite liberating and grants virtual freedom. Being on the computer can mean being connected to friends through websites like MySpace.com or Facebook.com, it also empowers Internet users with tools from Google or video broadcast sites. The Internet is a vast and seemingly public space yet people often access from a private physical bubble. The keyboard mouse interface is meant for one person, our culture approaches computers as personal devices, there are many factors which seem to isolate people and computers.

Proprosals Proposals Proposals

2008-10-08T04:09:00.000-07:00

I've been thinking about the senior project this past week and nothing has really hit me as the "It" project. The main themes which I would like to focus on include:

- suburbanization vs. virtualization - these two processes seem to do opposite things yet they exists side by side
- related to this dynamic is public transportation and the bus system - something which I've had a lot of experience with because of my time at UCSD

- social networking - how and why did this phenomenon come about and what are the consequences and benefits?

- cognitive science in general - how this field of study might inspire artistic explorations of human nature