F8 2017: Artificial Intelligence, Building 8 and more technology updates from day 2
April 19 concludes F8 2017, Facebook’s annual two-day event where developers and businesses come together to explore the future of technology.
In the opening keynote, Facebook Chief Technology Officer Mike Schroepfer talked about the company’s goal to develop technology that will help everyone build global community. To do that, Facebook is investing in three foundational technologies over the next 10 years: connectivity, artificial intelligence and virtual reality.
Schroepfer and other keynote speakers – Head of Connectivity Lab Yael Maguire, Director of Applied Machine Learning Joaquin Quiñonero Candela, Chief Scientist at Oculus Research Michael Abrash and Vice President of Building 8 Regina Dugan – shared updates and visions for some of the company’s long-term focus areas.
Read more about the topics in day 2 F8 keynotes below:
Rather than look for a one-size-fits-all connectivity solution, Facebook is investing in a building-block strategy – designing different technologies for specific use cases, which are then used together to create flexible and extensible networks.
Today, Facebook highlighted new milestones in its efforts to reach people who are unconnected and increase capacity and performance for everyone else. The Facebook team set three new records in wireless data transfer: 36 gigabits per second over 13 kilometers point-to-point using millimeter-wave (MMW) technology; 80 gigabits per second between those same points using the company’s optical cross-link technology; and 16 gigabits per second from a location on the ground to a circling Cessna aircraft over 7 km away using MMW. Additionally, Facebook’s Terragraph system being tested with San Jose in the city’s downtown corridor has become the first city-scale mesh millimeter-wave system capable of delivering fiber-like multi-gigabits/s of performance and reliability.
Facebook also announced Tether-tenna, a new kind of “insta-infrastructure” where a small helicopter tethered to a wire containing fiber and power can be deployed immediately to bring back connectivity in case of emergency.
AI is a powerful tool, and Facebook is leveraging it to build amazing visual experiences for people.
AI has revolutionized the ability of computers to process and understand images and videos. It’s easy to forget that only five years ago, computers saw images as just a collection of numbers, with no particular meaning to them. Now computers can understand every single individual pixel of an image. These advancements enable new experiences. For example, Facebook is working on using AI to help people discover the videos they care the most about.
Facebook believes AI belongs to everyone. That’s why yesterday the company announced that it is open sourcing Caffe2 – a framework to build and run AI algorithms on a phone – and building partnerships with Amazon, Intel, Microsoft, NVIDIA, Qualcomm, and others.
Another way Facebook is giving this technology back is through an AI-infused camera across Facebook, Instagram and Messenger. With the ability to run cutting edge AI and computer vision algorithms on the device, this camera can now understand your surroundings, recognize people, places and things. It can annotate and enhance images and video. The new Camera Effects Platform gives developers a way to build new tools for creative expression.
Facebook is investing in VR across mobile and PC hardware, software and content – from Oculus Rift and Gear VR toFacebook Spaces.
On day 2 of F8, the company introduced the newest designs for the Surround 360 camera that allows people to produce amazing high quality videos for VR. The new Surround 360 creates some of the most immersive and engaging content ever shot for VR. The new camera technology lets you move around within the video scene and experience the content from different viewing angles. This means you can move your head around in the world and see it from different angles, bringing the feeling of immersion and depth to a whole new level.
On day one of F8, Mark Zuckerberg talked about how the camera is the first augmented reality platform. On day two, Chief Scientist at Oculus Research Michael Abrash shared a vision for the path to full AR – where augmentation enhances your vision and hearing seamlessly while being light, comfortable, power-efficient and socially acceptable enough to accompany you everywhere.
He talked about the rise of virtual computing – which encompasses both virtual and augmented reality – as the next great wave after personal computing. Virtual computing is just starting to form, but it will give us the ability to transcend time and space to connect with one another in new ways.
In order to make virtual computing as much a part of everyday life as the smartphone is today, we’re going to need see-through augmented reality, which will likely be transparent glasses that can show virtual images overlaid on the real world.
The set of technologies needed to reach full AR doesn’t exist yet. This is a decade-long investment and it will require major advances in material science, perception, graphics and many other areas. But once that’s achieved, AR has the potential to enhance almost every aspect of our lives, revolutionizing how we work, play and interact.
Building 8 is the product development and research team at Facebook focused on creating and shipping new, category-defining consumer products that are social first, and that advance Facebook’s mission. Products from Building 8 will be powered by a breakthrough innovation engine modeled after DARPA and shipped at scale.
At F8 Facebook announced two technical projects aimed at the development of new, breakthrough communications platforms.
The company is working on a system that will let people type with their brains. Specifically, Facebook has a goal of creating a silent speech system capable of typing 100 words per minute straight from your brain – that’s five times faster than you can type on a smartphone today. This isn’t about decoding your random thoughts. Think of it like this: You take many photos and choose to share only some of them. Similarly, you have many thoughts and choose to share only some of them. This is about decoding those words you’ve already decided to share by sending them to the speech center of your brain. It’s a way to communicate with the speed and flexibility of your voice and the privacy of text. Facebook wants to do this with non-invasive, wearable sensors that can be manufactured at scale.
Facebook also has a project directed at allowing people to hear with their skin. The company is building the hardware and software necessary to deliver language through the skin.
For more details on day 2 topics, see Facebook’s Developer Blog and Engineering Blog. You can also watch all F8 keynotes on the Facebook for Developers Page. Find additional assets and product images on F8 press page.
Watch the full day two keynote here https://developers.facebook.com/videos