Facebook F8 2017 in 4 minutes Augmented reality, chat bots, AI and mind reading

When you read those words F8, Facebook Developer Conference is over. Like every year, Mark Zuckerberg and his staff showed us what they worked on in last months and how the future of social media will look like. If by any chance you missed keynote videos (day 1day 2) and didn’t have a chance to attend McEnery Convention Center in San Jose, we are here with a short summary of worth remembering announcements.

After revelations on F8 2016, Facebook’s direction stays unchanged in 2017 — extend our reality as much as possible by technologies like Augmented Reality, Virtual Reality, 3D cameras and everything else what could enrich the real world and make physical distance between people negligible.

In this year among the others we could see:

Camera effects — platform which turns our mobile devices into AR platform. You will be able not only add text or stickers to your photos and videos but also interact with them in 3D world model, drawing “around” cup of your favourite coffee or simply putting something on real-virtual table.

Facebook Spaces — virtual world in which thanks to VR systems from Oculus you will see and even interact with your friends and family, no matter if they are tens or thousands kilometers away.

AR Studio — for those who have artistic souls and gallery of camera effects isn’t enough, there is a tool which allows to build our own effects and animations.

And much, much more — AI to analyse people’s movement in realtime, new version of 3D 360 camera which gives us possibility to see places which weren’t be really photographed, but modelled by it’s software.

There are not much tech companies with Facebook scale, but most of them (like Google, Amazon, Netflix and others) are very keen to share their knowledge and experience with the world. Azimo’s tech team is proudly taking part in this contribution too, so we are even happier to hear about those great initiatives:

Facebook Developer Circles — similarly to Google Developer Groups or Apple educating the next generation how to code, Facebook builds its own knowledge sharing groups to help local communities, startups, entrepreneurs, and developers succeed.

Open source — It’s also unchanged that a lot of new technologies and solutions invented by facebook are shared with developers for free. Not telling about things released over the year, on F8 we could hear about some new projects for Android, JavaScript (React) and VR. There was also great announcement in field of Artificial Intelligence: Caffe2 — Deep Learning framework optimised to work on mobile devices (another one after Google’sTensorFlow). For sure it’ll bring more intelligence into mobile apps, especially in fields of computer vision, speech and language processing and much more for sure.

Connectivity — still there is a lot of places in the world where internet connection is limited or unavailable. Facebook continues their research in this field to make this medium of endless information widely distributed and high-speed.

One year after Facebook launched beta of Messenger Platform it seems that chatbots and rich messaging experience will stay with us for longer. During F8 we could hear about new list of features packed under Messenger Platform 2.0 version. Here you have list of the most important ones:

Discover Tab — That’s right, Messenger Bots have their own “apps store” where they are grouped by categories, popularity, location and others.

Smart replies — currently this feature is a bit mysterious, available for limited audience of businesses (mostly restaurants in US). While probably everyone heard about Artificial Intelligence, currently it’s still not easy to use it in reality. Even the simplest implementations require well qualified experts spending weeks to make it real. For small businesses it’s still beyond their reach.
With Smart Replies Facebook would like to change this situation — their AI is able to analyse fanpage, generate answers for frequently asked questions and use them in chatbot conversation. No additional implementation should be required on business side. With a few clicks you should be able to build your own chatbot powered by wit.ai, automatically answering questions like what are opening hours or what is today’s special.

Chat Extension — when one year ago Facebook presented Messenger Bots they worked as standalone apps with conversational interface. Now with Chat Extension you can finally add them directly into group or individual conversation. And it changes a lot! Let’s assume that you would like to send some money to your friend. Previously chatbot had to ask you who is your friend and how you would like to accomplish this action. Now, when bot knows the context (people who take part in conversation), setup steps aren’t needed — you can focus on what to do, not how.

Parametric Messenger Codes — QR-like codes for Messenger which should be able to open bot conversation with given context. Just imagine — you want to buy “this” hat. Instead of talking to clothing store chatbot, helloing him, simply scan Messenger Code on a label. Your conversation will start with the most intended question: “Would you like to buy it now? Yes/No.”

M — AI powered assistant currently available for really small group of users. Have you heard about Google Assistant, Samsung’s Bixby or Siri? That’s right — Facebook is catching up this area too.

At the end there is something what impressed us the most — Building 8. Like Google X, Facebook also wants to have it’s own moonshots. What it is? Wireless communication with brainwaves and speechless “talking” through skin. The technology of tomorrow is coming. To make the world a better place.

And that’s all from us, but definitely not everything what was announced on F8. Do you want more? You can see videos from all F8 talks.

Historical intro to AI planning languages Not only Machine Learning drives our autonomous cars

This is my 2nd publication in field of Artificial Intelligence, prepared as a part of my project in AI Nanodegree classes. This time the goal was to write research paper about important historical developments in the field of AI planning and search. I hope you will like it 🙂.

Planning or more precisely: automated planning and scheduling is one of the major fields of AI (among the others like: Machine Learning, Natural Language Processing, Computer Vision and more). Planning focuses on realisation of strategies or action sequences executed by:

  • Intelligent agents — the autonomous entities (software of hardware) being able to observe the world through different types of sensors and perform actions based on those observations.
  • Autonomous robots — physical intelligent agents which deliver goods (factory robots), keep our house clean (intelligent vacuum cleaners) or discover outer worlds in space missions.
  • Unmanned vehicles — autonomous cars, drones or robotic spacecrafts.

Continue readingHistorical intro to AI planning languages Not only Machine Learning drives our autonomous cars

Understanding AlphaGo How AI beat us in Go — game of profound complexity

One of required skills as an Artificial Intelligence engineer is ability to understand and explain highly technical research papers in this field. One of my projects as a student in AI Nanodegree classes is an analysis of seminal paper in the field of Game-Playing. The target of my analysis was Nature’s paper about technical side of AlphaGo — Google Deepmind system which for the first time in history beat elite professional Go player, winning by 5 games to 0 with European Go champion — Fan Hui.

The goal of this summary (and my future publications) is to make this knowledge widely understandable, especially for those who are just starting the journey in field of AI or those who doesn’t have any experience in this area at all.

The original paper — Mastering the game of Go with deep neural networks and tree search:

http://www.nature.com/nature/journal/v529/n7587/full/nature16961.htm

Continue readingUnderstanding AlphaGo How AI beat us in Go — game of profound complexity

Learning the Artificial Intelligence Why I’m taking AI Nanodegree program at Udacity

There is a time in our life when we mostly learn. Then over the time we learn less and use our knowledge more. And very often it’s not just one-way process but more like a cycle which ends and starts from beginning.
For me now is the moment when a new cycle is slowly starting.

Continue readingLearning the Artificial Intelligence Why I’m taking AI Nanodegree program at Udacity

Iron Man’s Jarvis — is it still a fiction?

Who doesn’t dream about Iron Man’s suit? Infinite power source — Vibranium Arc Reactor, ability to fly and dive thanks to Repulsors and oxygen supplies, almost indestructible single-crystal titanium armor with extremely danger weaponry.

Since we’re still years or even decades (are we?) from having at least prototype of flying metal suite, there is one piece of it which can be closer than we think.

JARVIS

While Vibranium Arc Reactor is a heart of Iron Man suit, the equally important thing is its brain — Jarvis.
Jarvis is a highly advanced computerized A.I. developed by Tony Stark, (…) to manage almost everything, especially matters related to technology, in Tony’s life.” Does it sound familiar? Continue reading “Iron Man’s Jarvis — is it still a fiction?”