The Projected Instrument Augmentation system (PIANO) was developed by pianists Katja Rogers and Amrei Röhlig and their colleagues at the University of Ulm in Germany. A screen attached to an electric piano has colourful blocks projected onto it that represent the notes. As the blocks of colour stream down the screen they meet the correct keyboard key at the exact moment that each one should be played.
Florian Schaub, who presented the system last month at the UbiComp conference in Zurich, Switzerland, said that users were impressed by how quickly they could play relatively well, which is hardly surprising given how easily we adapt to most screen interfaces these days.
But while there is real potential for PIANO as a self-guided teaching aid, in my view it’s the potential for a really tight feedback loop that makes this most interesting, and potentially more widely applicable.
When a piano teacher corrects a student’s mistake, they will perhaps specify one or two things that need improving, but this approach would sense each incorrect note and could provide an immediate visual response, flashing red for instance, conditioning the student to success more quickly.
In this post I’ll introduce you to my new pet project: an experiment in Twitter automation. The Strategy Bot (pictured) is ‘programmed’ to select & retweet key digital media resources, case studies or news items that provoke a higher understanding of the formation of good digital strategy.
He thinks, therefore he tweets.
Some context… I will typically have the odd side project on the go at any one time. Recent examples have included:
Recategorising all my RSS feeds for mobile, web & iPad
Linking up Instapaper / ReaditLater / Pinboard & Twitter
Testing Facebook ads to see if I can drive Twitter followers
Playing with XFBML, the new Follow button and Google +1
Sketching people’s Twitter avatars with my new stylus
All of the above would be worthy of a blog post, and that might happen for a couple of them, but there’s been one project I’ve been thinking about for a while that I reckon just needs to be shared, because, dear reader, I need your help!
I’ve been interested in getting the most out of Twitter for a while, and I’ve been certain there is some utility among the network’s parasites: the lowly twitterbot. I’d love to perform an autopsy on one to see how they really work, as there are some excellent cases of these automata being actually quite useful or cool. For example:
Spotibot – @replies suggested music based on your requests
Wikipediabot – random links to Wikipedia pages every hour
Easy Joke – RT’s with “that’s what she said” on certain phrases
There are loads more listed on the Twitter Fan Wiki, and of course there are millions of spambots that behave in similar ways. But I wanted to make something that would be primarily useful to me, and that others might enjoy too.
The idea arose from the need to detect, share and archive truly excellent links, without cluttering my personal Twitter feed. Did you know you can automatically add Twitter links to Pinboard for archiving? It’s a bloody useful way to passively log the stuff that’s held your attention. And did you know you can create a self-hosted archive of all your tweets? I use Tweetnest to this end, where I’ve been logging my personal tweets here. Try searching for something!
Mr. Strategy Bot is just another way to add useful stuff to my own personal content library. But throughout the course of his life, I’d like him to be useful to everyone. Or at least, everyone that works in digital media (you gotta have a niche). So how should I automate him to this end?
In my attempts to pin down what makes these robots work, I found a number of approaches, typically making use of Twitterfeed (a pretty blunt RSS syndication tool) or the Twitter API (way over my head). I needed something that would let me ‘scrape’ the top links from a list of Twitter users, and automatically RT the top five links.
I have totally failed in my attempts, even after a whole evening spent in the depths of Yahoo! Pipes. For now, I’ve had to settle on the manual way. Yep, I’m manually RT’ing the links until I find a better solution, five a day, with a bit of prose each time to help round out his character.
I will continue to research means of automating his behaviour, as I think the idea of one’s own personal virtual pet social robot is a really powerful idea. Wouldn’t you agree?
[box]Please leave a comment if you can help create virtual life! Let’s give this guy his own A.I. existence out in the digital ether.[/box]
In the meantime, you should follow him on Twitter here.
He’s programmed to follow back!
Life-Altering Line-Drawing Instrument Design Concept of the Day: Giha Woo’s “Constrained Ball” can be attached to any standard writing instrument to assist in the production of ruler-free lines. In addition, the device has a built-in LCD screen which displays the total length of any line drawn.
As others have noted, this would likely require at least one additional gear to create functional stability, but an interesting concept nonetheless.
