Hacking the Face API

Over the last couple of days, the Acando team has taken a deep dive into the Microsoft Face API (or cognitive services, or even “Project Oxford”) and discovered that it holds great potential for creating meaningful services.

First of all though, is understanding the API itself, and while the API is tremendously well documented, it takes a lot of practice to get it right.

First, you need to take a photo of the people you want to identify. Let’s start with this image:

The detect service will assign a temporary faceId. To make it persistent you need to create a “face list” which you can it into by calling the persongroups service. Of course, you can’t call the persongroup service without creating a “person group” first. So, you create a person group, then create a person, and then add the face from the face list to the person in the person group. Swell.

Okay, it sounds confusing, but when you got the workflow up and running, you can add more persons, more faces, and end up with a structure like this:

The next step is of course to use this information to further tag and identify faces from photographs. In our hack project we made an app where you can add people to your group and identify persons already in the group based on new photos.

Here are some screenshots:

Know your people

A quick update from Team Acando.

Unfortunately, the team has had a shortage of people this weekend and the team has suffered further challenges due to sickness. But as the remaining team members still wanting to attend this awesome event, the ambition of the team solution has been scaled down to fit the capacity of the team. We even tried reaching a technology solution, but using only snow and pinetrees from the forest around the hotel didn’t really fly…

But scaled down ambitions still means using the most funky piece of gear present in the misty hills of Voksenåsen this weekend. The Hololens.

Who hasn’t had the experience of meeting people in the office, just having no clue who it is. Well, here comes the HolaLens solution (working name: Facer). With a convenient app you can quickly scan the person and send the image of the person to your company’s SharePoint site. The SharePoint site will check with the Microsoft cognitive services using the Face API and using the results there look up the information of the person in the Contacts list. Voila, you have all the information in a blink of an eye to casually greet the person. And Hololens being the casual eyewear it is, will of course spark new interesting conversations with the person you met.

Do we want everyone in the office to walk around with Hololenses?? Absolutely!!

We are crossing our fingers that we can deliver on this bold ambition.