Programmed To Love

Two robots, Vincent & Emily, are connected to each other as if deeply in love: where at the heights of romance, every motion, utterance, or external influence is shared in an acutely empathic, highly attuned ’emotional’ response:

The creation of German artists Nikolas Schmid-Pfähler and Carolin Liebl, the robots take in sound and motion data–from each other and from spectators– via sensors, which causes them to react–via gears and motors–with certain expressions. Shown in a gallery and open to the interaction of visitors, the project aims to explore the ideal of the human couple by distilling it into a more basic form. Simple lines represent bodies. Reacting to inputs replaces complicated decision-making.

Like in any relationship, miscommunication is a factor – so an intimate moment can lead to conflict, and eventual resolution. This gives a certain texture to their ‘dance of love’ that makes it hard not to anthropomorphise, or indeed relate to!

Take a look:

Via Co.Exist.

Experts Predict The Next Decade In Mobile

Rudy de Waele has been a busy man. He’s curated 37 of the world’s most notable voices from Mobile & Academia for inclusion in his Mobile Trends 2020 slide deck – a collection of thoughts on where we’ll all be this time next decade:

“I asked some of my personal heroes in mobile to write down their five most significant trends for the coming decade. All of them have been of great inspiration to me during this decade: for their ideas, visions, talent, the capabilities to adapt and the perseverance to succeed whatever the situation.”

Here’s the deck. Hit fullscreen for best viewing experience:

These are my five stand-out ideas from the presentation. What are yours?

Digital syllogomania:

Digital garbage collection becomes a (very) lucrative business
Slide 10 / Fabien Girardin / Researcher at Lift Lab

Sensors:

Mobile devices will have sensors added which will enable the capture of local data from temperature to noise and from location to who else is on the room
Slide 13 / Tony Fish / Entrepreneur

Cellular voice dies:

It truly becomes another form of data on the next generation data networks
Slide 30 / Kevin C. Tofel / Managing Editor at jkOnTheRun

Mobiles manifesting AI:

Fulfilling, at last, the vision of “personal digital assistants”
Slide 33 / David Wood / Principal at Delta Wisdom

New sonic experiences:

Augmented reality, 3D sound, will create new mobile audio formats and end user experiences
Slide 41 / Atau Tanaka / Director of Culture Lab

On the Potential for Branded Robots

Last year I wrote about these awesome fighting robots from Japan, where  I asked this question:

“I am very interested in at least progressing research into the potential for branded robotics, androids & cybernetics if any readers have thoughts?”

I received an equally awesome response from one Pius Agius, who challenged me on my Western predilection to see robots fighting rather than fulfilling a higher place in society. I reproduce the key lines of our dialogue here:

“Because [the Japanese] accept robots as part of their daily lives more than a majority of those living in the west does not mean we in the so called west cannot build great machines […] We can make better use of our creations than place them in roman like battles. What does that say about us as a civilization?? Let us build machines that can develop and reach their full potential.”

Stunned to have stimulated such a well-considered response, in answer I cited a company that I think are making some great stuff in this field – Festo:

“I think their design-led approach is not only creating some very useful mechanisms, but can potentially change the way we in the West perceive robotics as part of everyday life.”

Check them out if you like – Festo do great stuff.

Meanwhile, I went to see what I could find out about the guy who’d crashed in with his well-considered comment. I found Pius dwelling on the vibrant community pages of Grandroids, a Ning-based social network full of heavyweight discussion on robotics. Members spoke of a ‘Steve Grand’ as the patriarch of their micro-culture. I’m coming back to this…

I don’t think I’ve mentioned this before, but I grew up surrounded by members of the Games Industry in Cambridge. My father was Director of Development at Millennium Interactive, which became Cyberlife, then Creature Labs, and then Gameware Development.

The common thread between these companies was a breakthrough series of Artificial Life games called Creatures. Cyberlife was created to commercialise the work of this very same Steve Grand, where together with a team of artists and programmers they went about developing the Creatures series.

Though artificial life simulators are now a well-established genre (Tamagotchi; Sims; EyePet), the series was first to reach critical and commercial acclaim. Players would take on the role of keepers to cutesy ‘Norns’. But these were no ordinary creations, and in the 90’s Creatures was far ahead of its time.

These creatures would learn and grow, each with their own neural network, and were motivated to survive, and eventually breed in order to pass on their digital genotype. They had the ability to adapt and evolve, iterating towards an understanding of and harmony with their environment.

Years later, Steve is well-established as the leading thinker in AI and robotics. As well as mounds of academic submissions, he’d been running a project to build a series of intelligent robots for rent, as crowd pullers in public events and trade shows. His first robot was a five foot tall humanoid female called Grace, I discovered.

Because I’d found myself on his site, and because I know the guy, I thought I’d go to Steve to ask my initial question once more:

Hello Steve,
This is Tom Saunter here, Ian’s son.

A member of this very network recently commented on my blog, and one Google later I found myself here. With such a vibrant community there’s so much to digest, so I thought I’d go straight to the source…

Part of my job these days is to seek out emerging technologies for advertising purposes, and now that I’ve read about your Grandroids project I am interested to hear your thoughts on how you feel robotics could be of benefit to brands and, in turn, to consumers.

Besides increased traffic to conference booths, what part do you feel your robots might reasonably play when faced with a brief to change the buying behaviours of the general public?

There’s got to be a great piece of research in there.
Do you know anyone who can help me with an answer?

All the best,
Tom

The response, and get ready for it, was this phenomenal piece of prose:

[…] So, um, how might robots like Grace change buying behaviours? God knows! They could certainly have an impact on brand perception, and I suspect that’s a double-edged sword. If the robot is suitably impressive then it improves the company’s image, but if it’s a bit naff then at best it’s just a novelty to draw crowds that the client would then have to secure by other means, and at worst it damages the client’s image.

For instance Asimo has done wonders for Honda’s public image (not in terms of AI, particularly, just general technology), but some other Japanese robots have fared less well, especially those that fall into the Valley of the Uncanny. In other words, they’re lifelike enough to trigger the circuits in our brains that detect things that “aren’t quite right” in other people (signs that we’re being deceived or threatened, say), but they’re not lifelike enough to actually pass the test, so we find them disconcerting. 3D computer games frequently suffer from the same problem, as I’m sure you know, and years ago I predicted that as 3D graphics got better, the demands on intelligent behaviour for game characters would grow intense.

Anyway, I’ve gone off on a tangent. It was a big factor in our design for Grace, though. We deliberately made her look like a robot and didn’t give her human-like skin, etc. Instead I relied on psychological cues of sexiness and lifelikeness that didn’t risk us falling into the Valley of the Uncanny. My point is, you have to get the psychology right or you won’t produce the positive associations in people’s minds that your client needs. The consumers aren’t necessarily going to be able to articulate these things, so they’ll feel bad without knowing why, and you could damage the brand rather than enhance it. I felt I had enough unique experience in designing artificial lifeforms to stay on the safe side of that boundary, though.

One of the things I was keen to achieve was understatement. There are various companies renting out “robots” as crowd pullers (although really they’re just animatronics or remote controlled) and they go for a big noisy splash – flashing lights, big press releases, comedy routines, etc. I wanted Grace to just sit there at the entrance to a booth and be as much like a normal sales girl as possible. I wanted people to do a double-take and then be intrigued. Let them discover it for themselves. It’s a bit like knowing you’ve just been passed by a really powerful motorcycle because you didn’t hear it coming. I think if you do something like this with a fanfare then people will be primed to find something wrong with it, but if you go for the soft sell then they’ll be supportive and impressed. When I wrote Creatures all those centuries ago, my prime principle was that I shouldn’t try to fool people into thinking norns were alive – I should really try my best to make them alive. If people knew I was being honest and doing my best then they’d be on my side, and I think the same is true here. Undersell the robot and you make their company look good by association, as if there’s a lot more under the hood of their products than they’re letting on.

There are also many other kinds of subliminal association that can work for you or against you depending on the client and your ability to tap into the right psychological triggers. I based the look of Grace on the robots Chris Cunningham designed for the video to go with Bjork’s “All is full of love”, because I think he got a lot of those triggers just right – especially the tension between femininity and technology. It’s a bit like designing the iPod – the right curves and the bits you leave out are so important. And with real robots you have to get the behaviour right too, which is a big subject all by itself. Almost all current robots fail miserably in that regard, especially by being too predictable and not subtle enough.

But I don’t think I’m really answering your question, am I? Sorry. Advertising and marketing aren’t my field (I have quite enough fields without adding any more). I don’t really know of anyone who knows about this stuff. One of our “competitors” in New York has a site where they talk quite a bit about the marketing potential of their remote-controlled “robots”, but I can’t for the life of me remember the name of the company (so maybe their advice doesn’t work!).

Looks like it’s down to you to figure it out…

There it is then. The planet’s preeminent ALife & robotics academic, whom has been referred to by Richard Dawkins as “the creator of what I think is the nearest approach to artificial life so far”, is leaving it up to us to answer the big questions:

  • What is the potential for branded robots?
  • Will they ever form part of a marketing strategy?
  • Will we ever allow robots a part in everyday life?

And so, I ask again, dear reader, what do you think?

Let me know in the comments.

Gameware: A Case-Study in AR Development

I have been aided in this series by a connection with Gameware Development Limited, a Cambridge-based commercial enterprise working in the entertainment industry. Gameware was formed in May 2003 from Creature Labs Ltd, developing for the PC games market which produced the market leading game in Artificial Intelligence (AI), Creatures. When Gameware was formed, a strategic decision was made to move away from retail products and into the provision of technical services. They now work within the Broadcasting and Mobile Telephony space in addition to the traditional PC market. I use this business as a platform to launch into a discussion of the developments current and past that could see AR become a part of contemporary life, and just why AR is such a promising technology.

Gameware’s first explorations into AR came when they were commissioned by the BBC to develop an AR engine and software toolkit for a television show to be aired on the CBBC channel. The toolkit lets children build virtual creatures or zooks at home on their PCs which are uploaded back to the BBC and assessed:

 

A typical Zook, screenshot taken from Gameware's Zook Kit which lets children build virtual creatures
A typical Zook, screenshot taken from Gameware's Zook Kit which lets children build virtual creatures

 

The children with the best designs are then invited to the BAMZOOKi studio to have their virtual creatures compete against each other in a purpose-built arena comprised of real and digital elements. The zooks themselves are not real, of course, but the children can see silhouettes of digital action projected onto the arena in front of them. Each camera has an auxiliary camera pointed at AR markers on the studio ceiling, meaning each camera’s exact location in relation to the simulated events can be processed in real time. The digital creatures are stitched into the footage, and are then navigable and zoomable as if they were real studio elements. No post-production is necessary. BAMZOOKi is currently in its fourth series, with repeats aired daily:

 

BAMZOOKi, BBC's AR game show where children’s zooks compete in a studio environment
BAMZOOKi, BBC's AR game show where children’s zooks compete in a studio environment

 

BAMZOOKi has earned Childrens BBC some of its highest viewing figures (up to 1.2 million for the Monday shows on BBC1 and around 100,000 for each of the 20 episodes shown on digital Children’s BBC), which represents a massive milestone for AR and its emergence as a mainstream media technology. The evidence shows that there is a willing audience already receptive to contemporary AR applications. Further to the viewing figures the commercial arm of the BBC, BBC Worldwide, is in talks to distribute the BAMZOOKi format across the world, with its AR engine as its biggest USP. Gameware hold the rights required to further develop their BAMZOOKi intellectual property (IP), and are currently working on a stripped down version of their complex AR engine for the mobile telephony market.

I argue, however, that Broadcast AR is not the central application of AR technologies, merely an enabler for its wider applicability in other, more potent forms of media. Mobile AR offers a new channel of distribution for a variety of media forms, and it is its flexibility as a platform that could see it become a mainstream medium. Its successful deployment and reception is reliant on a number of cooperating factors; the innovation of its developers and the quality of the actual product being just part of the overall success the imminent release.

As well as their AR research, Gameware creates innovative digital games based on their Creatures AI engine. They recently produced Creebies; a digital game for Nokia Corp. Creebies is one of the first 3D games which incorporates AI for mobile phones. Gameware’s relationship with Nokia was strengthened when Nokia named them Pro-Developers. This is a title that grants Gameware a certain advantage: access to prototype mobile devices, hardware specifications, programming tools and their own Symbian operating system (Symbian OS) for mobile platforms. It was this development in combination with their experiences with BAMZOOKi and a long-standing collaboration with Cambridge University which has led to the idea for their HARVEE project. HARVEE stands for Handheld Augmented Reality Virtual Entertainment Engine.

Their product allows full 3D virtual objects to co-exist with real objects in physical space, viewed through the AR Device, which are animated, interactive and navigable, meaning the software can make changes to the objects as required, providing much space for interesting digital content. The applications of such a tool range from simple toy products; advertising outlets; tourist information or multiplayer game applications; to complex visualisations of weather movements; collaborating on engineering or architectural problems; or even implementing massive city-wide databases of knowledge where users might ‘tag’ buildings with their own graphical labels that might be useful to other AR users. There is rich potential here.

In HARVEE, Gameware attempt to surmount the limitations of current AR hardware in order to deliver the latest in interactive reality imaging to a new and potentially huge user base. Indeed, Nokia’s own market research suggests that AR-capable Smartphones will be owned by 25% of all consumers by 2009 (Nokia Research Centre Cambridge, non-public document). Mobile AR of the type HARVEE hopes to achieve represents not only a significant technical challenge, but also a potentially revolutionary step in mobile telephony technologies and the entertainment industry.

Gameware’s HARVEE project is essentially the creation of an SDK (Software Development Kit) which will allow developers to create content deliverable via their own Mobile AR applications. The SDK is written with the developer in mind, and does the difficult work of augmenting images and information related to the content. This simple yet flexible approach opens up a space for various types of AR content created at low cost for developers and end-users. I see Mobile AR’s visibility on the open market the only impediment to its success, and I believe that its simplicity of concept could see it become a participatory mass-medium of user-generated and mainstream commercial content.