Skip to main content
Basement Chronicles

A Sign

"He talks in maths
He buzzes like a fridge"

I really wish I could find that freaking CD. I'm guessing I lent it to someone and forgot about it. Oh well.

I had an idea today. And surprisingly, I didn't think it up when I was falling asleep, and it doesn't involve drawing parallels between computing and mental processes. Lucky you.

It does, however, have to deal with computers. Sorry folks, they're my life, and like it or not they'll soon control you, your children, and your grandchildren. I, personally, enjoy the fact that I'm going to have to establish a "No portable electronics" rule at my dinner table when I decide to have kids. It'll be the greatest and most ironic power trip ever.

I was thinking today when I was sitting in my assembly programming lab how the deaf guy next to me understood any of the crap we have to wade through. With all of the acronyms, mathematical concepts, and sheer insight required in the subject, I've got much respect for how well he does in the class. He's also a terrible distraction, as I spend the entire lecture hour trying to figure out how to translate the sign language the interpreters at the front of the room are doing for him.

I also got to thinking about how computers have been interfacing with humans for the past 20 years. First it was punchcards, next keypads, next keyboards, next mice, and then...wait. There haven't really been any great advances in computer interfaces since I've begun my computing career playing Commander Keen. What gives? With the amazing advances in speed, memory, and sheer capability, why are we still clacking away at a keyboard?

Then it struck me. Why has nobody tried to interpret sign language with computers? I've heard nothing, but I guess that that really doesn't mean anything. But then I got to thinking more on it, and the more I liked the idea. Imagine, if you will, an interface where...well...you could essentially design it with your own two hands.

You could start by defining a hand symbol for yes and no (thumbs up, thumbs down), and it could just develop from there. If, say, you were to apply such a system to a touch screen, there could be an interesting relationship with pointing to something with one hand and signing "delete" with the other. Given that same situation, you could circle something with one hand, and then tap elsewhere, performing a copy operation. Instead make a square around items in question, and its a cut operation. There is also the possibility of the Minortiy Report-esque interface where you directly interact with a screen based on where your eyes are situated.

Mentioning Minority Report, I understand that it has already been imagined, but I don't quite think that its possibilities have quite been examined. There could be an entirely new dimension to passwords based on the positioning and speed of your wrists and ten fingers, all operating seperate of each other. Very hard to duplicate, I would say.

It also offers an entirely new avenue for input. For instance, instead of typing messages letter by letter as we do with today's keyboards, we could instead sign entire words into it. Granted, sign language does not follow the same grammar written or spoken language does, but there are already excellent context guessing grammar spellcheckers out there.

What also makes me happy about this concept is that deaf people would be kings among men if an interface such as this ever become popular.

I'm gonna have to do some research on this one, as I obviously don't have a clue whether this path has been walked before. I'll get back to you later, right now its time for some super crunchy saltine cracker action.