vrijdag 28 maart 2008

Project presentation : Part I

The past couple of days I really needed to focus my attention back to my research. Trying to define in a better way of what it is that I am going to do research on. In this thinking process I came to ask myself three questions. For starters, "What is a board game?", it seemed that everyone had a different opinion on what a board game is exactly. The second question was "Where does a board game ends being a board game and begins to become a video game?". And third, "Why bother?". I can't exactly give you the answeres yet as some are a bit vague, but I kept on thinking and this is the outcome which I presented today.

I became really fascinated on a new way of gaming, a new genre perhaps. It's the question mark which lays between the 'Traditional Board Games' and the 'Video Games'. It's not yet possible to imagin the feeling one experiences when playing an interactive board game. And so my new research question became the following:

"What can a multi-user, multi-touch table mean for the future of board games?"

Before this can be answered a couple of things are needed. First I will need to do research on the possibilities of a multi-touch table, look into the benefits and added value of such a device and write down the restrictions of a board game. But also mention the other way around, what are the added value of a board game and the restrictions of a multi-touch table.

After that schedule has been set I can pick a popular board game and begin experimenting by adding benefits of a multi-touch table into the game and look at the outcome.

Why bother? A very annoying but good question. Well first of all, to keep up with time and technology. We are living in a digital generation, with our mobile phones, computers and so on. It's only a logical step that on some point the board game would get modernized as well. And now that the multi-touch technology here, that is possible! Second of all, to remove the restrictions of a board game and to embrase the new possibilities a multi-touch table has to offer.

I decided that my target audience will be your every day family that enjoys sitting around a game board and playing a game.

Then one last thing, the quest for a beamer may have ended. More news coming up.

dinsdag 25 maart 2008

Quest for the short-throw projector

I had to return the beamer today and tried if I could arrange it so that I could borrow it for the rest of the project. Unfortunatly school couldn't approve to that request and so my quest started in finding a company that could sponsor me a beamer, preferably short-throw, so I don't have to use a mirror. I am still looking.

The current state is that I have no beamer and therefor I can't finish my setup. I decided to investigate into how to write a class for Adobe Flash that can retrieve the data that is being send using the TUIO protocol and to process the data for easy use for my game experiments.

The class will be written in such a way that it will fire events for a finger press, release and drag and will give access to information like finger position, pressure and delta. I will continue developing this in the upcomming days.

zaterdag 22 maart 2008

Working setup

Wow it has been more then three days that I have posted something. This doesn't mean that I haven't been doing anything related to the multi-touch assignment. On wednesday I had to go to school to borrow a beamer and to talk to a teacher called Willem-Jan who kindly helped me putting some perspective into my research. He told me that writing is a dynamic proces, that I could change everything at anytime.

Also I tried, with help, to figure out what it is I am exactly fascinated by, what I want to do research on and why I should bother. Why would you want to play boardgame type of games on a multi-touch device while the traditional board games already show that they are working and fun? Anyway I got the assignment to make a table with on one side the traditional boardgames and it's uniqueness comparing to a multi-touch version, mostly focussing on the restrictments. On the other side I would have the multi-touch version with it's added value.

The most important thing I have to do research on is a thing I call the 'Casino Effect' in boardgames. Let me give an example to explain, imagin you just won 200 points on the slots, instead of immediatly adding those points to the total score, you let it add the points over a certain amount of time with maybe even some sound that goes louder the closer it get's to the new amount of points. The whole illusion is that those 200 points in this way, feel a lot more.

Some notes on benefits of a multi-touch table:
* Downloadable content
* The size of the board can be as large as you like
* You can play against the computer (together or alone)
* The ability to create your own map
* The ability to share your map with others
* Add-ons or modifications by others to the game can be shared as well
* Easy customization for theme

After this I used the beamer to finish the second prototype and had it soon fully operational. It worked!! And it worked well!! So after playing around with it, looking into how I can calibrate and tweak I talked to Erwin what would happend if you played catan realtime. Something I am going to develop and experiment with.

Also one major issue is, that I have to think clearly how I am going to test.

So on thursday I tweaked my screen a little bit and had to build the whole setup in my house, which was kinda hard because I want everything to be perfect and I didn't have the material. So I eventually fixed it with my coffee table on the side, which is balancing for 50% on my computer and the other 50% it's being pressed against the wall by a desk. Below the coffeetable I have a beamer pointing upwards and next to it the camera. I don't use a mirror because of three ghost images. I used towels to close the whole thing up. To make the blobs better and to fetch the tracing well I used oil on the screen.

dinsdag 18 maart 2008

Playing with the second prototype: Part II

Today I had to look for duct tape to tape the edges where the infra red light could escape out of the frame and I had to look for some tracing paper to work as a diffuse material. I settle for coroplast PVC tape and patternpaper, which I didn't even know it existed and if it would work.

I placed all the wires and leds within the frame and taped it so I don't have to worry about accidently breaking the wires. After this was done I was glad to see that I didn't have to worry about hoovering hands anymore.

Next was the possition of the diffuse material, it appeared that if I put it in front my blobs didn't get through, that's probably why you need a small layer of silicon to make that work. I put it behind the acrylic, so at the bottom, and my blobs did went through.

Now I have a working multi-touch input device, but not yet a multi-touch screen. So tomorrow I will borrow a beamer to project the image on my screen and hopefully that will be it.

I know the picture below is a bit chaotic, but it does describe what it will look like tomorrow.

maandag 17 maart 2008

Playing with the second prototype: Part I

The light of the leds were so strong that even when you hoovered with your hands from about 30 to 40 cm it would still detect your fingers. Meaning I had a hoovering multi-touch table, not quiet what I wanted. So I tried putting the adapter from 12V to 9V but that didn't make a very big difference.

After playing with it some more I came to the conclusion that the light could break free from small gaps between the acrylic and the aliminium, so now I have to buy some duct type to fill the gaps and hopefully it will work.

In the meantime I had to go to school to return the beamer and I have to come up with a structure for my research subject.

zaterdag 15 maart 2008

Second prototype nearly done

Today I worked really hard to get the second prototype up and running. Paul soldered the last part of the leds together and I drilled holes in the aliminium so I could screw the L-shaped brackets in. After this was done, we tested the leds at Paul's place with his simple non-modified webcam. We were very nervouse due the fact we only had one chance, doing something wrong would mean that all the leds will burn and I would have to buy new leds. Luckely for us, everything worked like a charm.

With the frame and the leds I went home and had to do something really borring, namely tape every single led so we know for sure it won't break because it might hit the aliminium or something. After that I had to put it in the frame, which was harder then I thought because some of the holes were to large making the led constantly pop out. Next I could test and this is the first result (without the bandpass filter on the camera).

vrijdag 14 maart 2008

Building second prototype

Alright instead of a story line, this time I'll post a sum of events. So on wednesday eve, I got the 30 IR Leds and with that I had all the equipment to start building the second prototype. I brought all the stuff from the shopping list to my good friend Paul van Dalen, who helped me putting it all together.

Unfortunatly we saw that the 10mm space in the H-shaped aliminium bar was including the thick edges and the acrylic of 8mm did NOT fit in. So we had to find another solution and so we decided to make the aliminium go all the way around the acrylic and let the L-shaped braces stick out a bit so that it can hold it.

It all cost more time then I expected and so at the end of the night we had the aliminium frame, with the holes and we had part of the soldering done. Then the next day, my unibrain firewire camera arrived with the lens and I was able to lend a beamer from school for the weekend.

Tomorrow, saturday, I will again go to my friend to finish the frame. I wish I could take photo's of the development, but unfortunatly I don't have a photo camera.

Tonight I will install and connect the unibrain camera to see it's speed and to see how it picks up infrared light.

woensdag 12 maart 2008

Project proposal presentation

So the project proposal presentation was pretty exciting seen the fact that after the five minutes you got for giving your presentation you were told if you were allowed to continue your project or not. Luckely for me it was approved, however, I needed to remove the word properly in my research question. So for now, my research questions is going to be:

"How can you translated a traditional
board game into a multi-touch edition?"

Also I had hard time phrasing that what I want to do, but I guess I can best describe it as finding multi-touch solutions for common game problems that have already been solved in someway for traditional board games. Like the die, that has been found to generate a random number.

If you take a board game like cluedo, you could extract game solutions like the dice, the weapons, the pawns that represent the character, the cards that represent a character, weapon or room, the spaces on the board and the rooms. How can you put all these elements into a multi-touch screen and make the experience of that game even more fun.

As an example I will translate one traditional board game into a multi-touch edition, where I will describe my work progress in my supportive narrative, argumenting every decision I make.

maandag 10 maart 2008

Project proposal presentation preperation

Today was all about the project proposal presentation which must be held at my school tomorrow. In this presentation I will give my working title, "The Multi-Touch Board Game Experience". Honostly I am not really satisfied with that title but I can't come up with a better one so I just leave it. Next I will need to answer the question how my subject is related to my field of studies.

Your finger as an input on single touch devices, instead of buttons, mouse or keyboard is nothing new. We can see it in most devices we know today like mobile phones, pda's, iPod's, etc. The game industry picked this up as well and it was Nintendo that decided to bring up the first handheld console that uses a touch screen as an input for it's games.

Looking at the big companies like Apple, who brought the new iPod Touch and the iPhone, Microsoft, who is going to bring us Surface and Windows 8, and Philips with it's Entertaible we can see that they are experimenting with a new technology, multi-touch, and are currently doing a lot of research on it's potential.

Although I don't know much about Apple's connection with games I do know that Microsoft hired a group called Carbonated games to design and develop games to test their Surface and that Philips has a whole research team on how traditional board games can be modernized. My goal is to contribute in this research about multi touch gaming.

I first wanted to do research on how games can benefit from a multi-touch device, but as that's way to broad I narrowed it down to board game translations. So my research question for now will be: "How can you properly translate a traditional board game to a multi-touch edition?". This is what my supportive narrative will be covering.

For my project, I will build a multi-touch table and as an end result I will have a playable multi-touch version of a traditional board game.

That's basicly what I am going to tell in my presentation tomorrow. Now I need to practice it.

zaterdag 8 maart 2008

My visit with Laurence Muller

Laurence Muller is a master of Grid Computing student at the Universiteit of Amsterdam, he has been researching multi-touch screens since the summer of 2007. I visited him at his school on friday to see and experience his setup and play with the applications he could offer me. A big thanks to him for answering my endless amount of questions.

The setup he eventually choose was that of RI (Rear Illumination), which basicly means that the infrared light comes from behind instead of in the table top. The reason he choose this setup is because the FTIR setup can't recognize objects and he needed that.

First of all he looked at the photo's on my website and asked himself the question rather or not the camera was seeying IR properly. So I asked him what he used and he used a FireWire webcam from unibrain called the Fire-i Board Camera Color. A lot of people that are building multi-touch devices confirm that firewire camera's are the way to go, because they can process streaming data much faster. There were also some people that claim that USB is also slower because it uses a compression techniques to get the images across the (narrow) USB bus.

I am also going to order my Fire-i Board Camera Color (€68) on monday, together with a 4.3mm standard lens without the IR coating (€12).

The camera then only needs a proper bandpass filter to filter out the visible light and only let the infrared light come in. I will be using black photonegatives for this.

So next, the frame. After the whole frame has been build, with the wires, the leds and the plexiglas I should already detect blobs from the fingers. With touchlib running on the computer I could already test it out. For tracing and dragging of objects however, this setup needs to be improved for better performance. From what I've been told when you drag your finger across the glass there will be more air between the finger and the glass making the blob less clear. To get rid of this, you will need a silicon, like Sort a Clear 40, layer. On top of the silicon you will place the diffuse material, the nuigroup stated that rosco grey is the best way to go, but very hard to get as well. The cheapest solution would be tracing paper. The good thing about Rosco grey is that it blocks IR light from the outside, making the table more usable in different kind of environments.

Alright to put things into perspective, the layers will look as follows:
- Finger
- Projection Screen
- Silicon Rubber Sheet
- Acrylic

Last but not least, Laurence told me that in the meantime I could already look into developing applications for my future touchscreen by using the reactivision tuio simulator to simulate finger touches.

Download the latest version of Touchlib from http://nuigroup.com/touchlib/downloads/
Download the latest version of Reactable from http://reactable.iua.upf.edu/?software

donderdag 6 maart 2008

The second prototype

Now that I know that the technique works, I decided that for my second prototype I will build the frame based on the FTIR technique which is shown in the picture below.


The infra red light from the leds will go into the acrylic pane and bounces up and down through the material. When a finger touches the acrylic the light gets frustrated and you will be able to detect a white spot, also known as a blob, with a camera that detects infra red light.

I am still waiting on the leds, but I already possess the acrylic pane. So for the next prototype I still need the aliminium H-shaped bar to build the frame, L-shaped brackets with screws to keep the frame together, wires to connect the leds with, resistors so the leds won't explode and a 12V adapter to give power.

I could buy most of the material at the following store:
Hubo
Badhuisstraat 95-101
2584 HE, The Hague (Netherlands)
(00)(31)703540360
There a bought the H-shaped aluminium bar (30x10x200), the L-shaped brackets and the screws for only € 11.10.

Now I need to go to an electric store to buy the wires, resistors and adapter.

woensdag 5 maart 2008

First working prototype

Today I got a working FTIR prototype, nothing fancy yet, but at least it shows that the technique works. I used the following material for this test:
- Wii sensor bar 
Will do for this test, still waiting on my ir leds order.
- Acrylic
8mm thick, 41 x 31 cm, to maintain 4:3 ratio.
- Logitech webcam
Adjusted to see IR led.
The Wii sensor bar came with my Nintendo Wii system.
The acrylic I bought from a store close to me for only €19, the edges still had scratches so it needed to be polished. I was to lazy to polish the edges myself and so I found a store who could do it for me:
Scheveningse Glashandel
Heemraadstraat 249 A
2586 SW, The Hague (Netherlands)
(00)(31)703550488
I wish I could tell you which Logitech webcam I used and how expensive it was, but unfortunatly I can't trace it back. I can however tell you that I got it from the following store:
MEG@1
Badhuisstraat 81
2584 HE, The Hague (Netherlands)
(00)(31)703227578
It's a ball-shaped webcam that really looks like the Logitech QuickCam. The camera itself is not enough, I had to convert it to an IR webcam. To do this I needed to remove the IR blocker which is found in every webcam (it filters the IR light to a certain degree). If you open the webcam it's the small red piece of glass between the chip and the lens. In my case I had to break it, because it was glued on. After putting it all together again I got the following results by shining the Wii sensor bar to my hand or a ten euro bill:

Alright so I had the IR webcam working, got the acrylic polished and the IR leds from my wii sensor bar. It was time to test it out! I placed the Wii sensor bar against the edges of the acrylic and did some testing with my fingers touching it. Guess what, it worked.

dinsdag 4 maart 2008

Catan on Xbox Live Arcade

As for an expension on my field research I wanted to play The Settlers of Catan on the xBox, because I heared a lot of good comments on it and I wanted to experience what that fuzz is all about.

The electronic version on the xBox is called Catan, which can be bought and downloaded from the xBox Live Arcade. I already knew how the game is being played and therefor I thought I could get away with just downloading the demo for free. After loading the game I quickly bumped against some annoying demo restrictions, first of all I could only play a match against the computer and second of all in the beginning of the game I wasn't allowed to pick the places for my settlements. But that all couldn't destract me from my purpose to get a feeling of playing the game.

I soon came to the conclusion that I haven't played the game for such a long time that I forgot about most of the game rules. As I didn't feel like going through the whole tutorial first I decided to go with re-discovering the game rules as we go.

The game went really quickly and the resources went all over the place, I had no idea how the trading function worked and I had no idea what the computer had done or what I should do in my turn, besides throwing the dice. Which, by the way, didn't annoyed me so much as I thought it would. You pressed a button, the 3d dice appeared and rolled over the game board (including the sound of rolling dices) and quickly stopped with a number.

After a certain amount of turns the demo version expired and asked me to buy the full game. I didn't feel satisfied with this experience and so I decided to buy the full game. Now I had the option to play against the computer as before or to play online against up to four players around the world, the decision was not hard to make.

Once online I noticed that I could plugin a microphone to my joystick and actually talk to the people in the room. This had an enormous impact on the fun I experienced while playing the game. I came across people from canada, arizona, denmark, germany but also closer to home, the netherlands. They kindly filled in the gaps I didn't know about the game rules and instead of waiting for anyone to accept your trading offer you could easily ask if someone wants to trade and you could actually negotiate.

After spending some time playing and talking to all sorts of people I came to a logic though interesting conclusion that the feeling of enjoying a game doesn't limit itself to the game rules, it's the whole experience around it.

For example I joined a game and it was filled with people from canada and they kindly wanted to answer some of my questions I had for them. One of these questions was how they experienced the dices in the game, at that time I still thought it was one dice, two dices. The guy bursted into laughter and after some time he said I sounded like Arnold Schwarzenegger, constantly saying "dices" like Arnold would. So the whole room, including me, was laughing and after that stopped he corrected me and said it was one die, two dice and I learned something. Of course he continued talking like Arnold for the rest of that round.

The thing is after I was done playing the game, I felt really good and wanted to play the game again. Besides I ended up with meeting all sorts of new people which some of them even added me to a so called friendslist on xBox.

To conclude this story I came up with some pro's and con's for the electronic game board:
(Keep in mind that for this example I didn't think of people gathering around a computer like the multi-touch would do, but purely playing solo on a PC, possibly against people online)
+ Try before you buy.
+ Tutorial to lead you through the game rules.
+ Send unbalancing issues or suggestions to the game designer.
+ Possibility to download expansions or modifications from out the community.
+ Not limited to a place, you can play against people from around the world, from their home.
+ Game elements like dice and cards won't get lost or damaged.
+ You don't need to clean up after playing.

- After a certain number has been thrown a lot, you blaim the computer. Rumours are currently being spread that the random function in Catan ain't that random, that it looks at the current game state and decides a number from that.
- You lose the actual feeling of the cards, the dice, etc.
- You can not see the person you are playing against.
- If you don't agree on certain game rules with the people you are playing with, it's mostly hard to adjust them. While with traditional board games you could come up with any kind of 'extra' game rule on the fly and after agreeying start playing with it.
- With the traditional board games people are more tempted to stay till the end while with an online version you have a high change of people leaving if they feel like they are going to lose.
- Cheat sensitive; With catan two people decided to talk to each other in private using the voice chat option on the xbox and agreed to only help each other giving each other what they needed. Besides if someone is leaving he could give all his resources to another player, giving that player an unfair advantage. The other players can't do anything about it because they are restricted to the options the game has to offer. While in traditional board games you could really look into someones eyes and say it's unfair and that you won't play further untill justice has been reached.

IR LED quest

The quest for the IR Leds has begun, I was looking for some 3mm IR-Leds (850nm) in the city, but could only found one company who sold them for €1,- a piece, which I found way to expensive. So I went on the internet and found a website called Leds-buy.nl, which appears to be a dutch company that sells IR-Leds for about €0.19 a piece, or €0.14 a piece if you ordered 25+. I placed my order for 35 leds, five extra just in case, and decided to get my resistors at Stuut & Bruin since they only charged me €0.05 a piece for it. Then I also needed a power adapter to power the leds and this they could sell me for €12,-.

So to sum it up:
€ 12.00 -  1x 12 DC; 1000mA Adapter
€ 4.90 - 35x 5mm IR-Leds; 850nm
€ 0.25 - 5x 68ohm resistors
----------------------------------
€ 17.25 - Total

zondag 2 maart 2008

Shopping list FTIR setup

I created the following shoppinglist for constructing my touchscreen prototype which is based on Frustrated Total Internal Reflection (FTIR). Tomorrow I will investigate where I can buy the material and I will add the prices.

FTIR Prototype Shoppinglist
______________________

1x
Camera

Fire-I Board Camera Color

1x
Camera IR Lens

4.3mm Standard Lens (NO IR COATING)

1x
Acrylic

8mm thick, 41cm x 31cm, with smooth edges

1x
Metal Polishes (optional)

Brasso

1x
Sandpaper (optional)

Norton T223 / P320; Auto-paper P800A and P1200A

1x
H-Shaped Aluminium Frame

3cm x 164cm

4x
L-Shaped Brackets


16x
Screws

1x
Adapter
12v DC; 1000mA

30x
IR LEDS
850nm; 20 mA; 1,8V

5x
Resistors

68 ohms

Graduation project proposal

Last friday we had to upload our graduation project proposal, below you will find some of the questions we had to answer for that.

Short description of the project
Please explain what you will create in your graduation project, in what context it will function, and what the actual expected result will be.

My creation will be a small multi-user, multi-touch table with a unique version of a board game running on it. Most board games that are translated to a PC version or console are directly ported, including objects like dice, cards, pawns, etc. In this version the research will tell me for example if the dice are really needed or if it can be automated by the computer, does it necessarily need to be a dice or can it be solved in another, more exciting, way using the full benefits of the table? It will include all sorts of new game design solutions for that board game, that will work only for a multi-user, multi-touch table and can’t be done without it.


Description focus of supportive narrative
You’ll need to write a supportive narrative related to your project work (e.g. a thesis, essay, paper or design document). What will be the focus of this supportive narrative in terms of subject / topic and direction?

My supportive narrative will be all about the traditional board game to electronic board game evolution. What has been done, what has been thought off, what has been tried, what worked, what didn’t work, and most importantly why. Can an electronic board game eventually replace the traditional board game? Are we waiting for board games to get modernized? And so on. In the end I want to pick a traditional board game that has the most common game elements (eg. dice, cards, etc.). So I can create an example of how those game elements can be implemented in a proper way in an electronic version. I am not automatically saying that everything has to change, that depends on the research. For example do people actually want to throw dice on an electronic version, does that give them the same satisfaction, or can it be solved in another way that is even better.

You have to keep in mind that when people see dice they expect to use it in a natural way, pick it up, shake it and throw it. On a touch screen it comes pretty close, you could pick it up with a finger then shake it a bit and then throw it, but due the fact you don’t actually feel the dice, does it reach the same effect? Sometimes it’s not better to simulate but rather to think out of the box and to try something new.


Interconnection between graduation project and supportive narrative
Very important question: how are project and its supportive narrative related?
How do you ensure that project and the supportive narrative will result in a coherent piece of work which are mutually dependent? (the one cannot go without the other).

At first the supportive narrative will function as a ground work for my prototypes, after that it will function as proof. It describes how I came to a certain solution and if that solution worked or didn’t work and most importantly why. The reason for this is that if anyone would ask me why I got rid of the dices for example, I don’t have to answer “Because I thought it was cool to try something different”, I can tell them that my research proved that the solution I choose worked better then the solution they thought of when designing the board game and I can even give them grounded arguments for that. So with this idea in mind, yea, the one cannot go without the other.


Planning graduation project (in phases)

Write a short planning for your graduation project, up to August 2008 (f.ii divided in pre-production, production and post-production). Make sure to address your research and writing of your supportive narrative in this planning as well.
P.S. Also include any other unfinished course work. Also indicate if you need any extra support in finishing these modules.

January 2008
• Symposium
• Start work groups
• Lecture field research
• Presentation proposal field research

February 2008
• Start field research on girl gaming
• Presentation results field research
• Start second field research on gaming with a multi-user, multi-touch table
• Create weblog with the results of the field research
• Proposal supervision I
• Proposal supervision II : Peer review
• Final version graduation project proposal

March 2008
• Research on multi-user, multi-touch table construction methods (FTIR or DI)
• Inventarisation of the required material, where to get it and the price
• Order the required materials and buy what can be bought immediately
• Design and build the frame (including LEDS), test technique
• Tweak box and table
• Start doing research for the supportive narrative

April 2008
• Learn to build applications for the hardware
• Improve box if needed
• Decide a board game depending on the results of the research
• Quickly start prototyping

May / June 2008
• User test prototypes on usability and experience
• Write down results and conclusions in the supportive narrative

July 2008
• Catch up month
• Final version supportive narrative
• Final version project