New Programmable Video capabilities let developers bridge real-time audio and video with augmented reality metadata
SAN FRANCISCO, CA--(Marketwired - Oct 26, 2017) - Twilio (
Augmented reality applications utilize a device's camera and microphone to overlay virtual content onto real-world environments through a video stream, enabling users to see and experience digital objects and information as if they were physically present. In the past, augmented reality applications have been largely built for a single user due to the massive complexity of implementing a shared or collaborative experience. In order to connect multi-user voice and video to an AR app, developers would need to first solve audio and video routing and streaming, as well as data-synchronization -- all in real time.
Twilio Programmable Video now solves these problems and enables developers to create entirely new kinds of augmented reality apps with the following communications capabilities:
These new capabilities in Twilio's Programmable Video platform work alongside AR capabilities such as Apple's ARKit and Google's ARCore.
"Augmented reality is completely transforming the way we understand and interact with the world around us, especially in terms of remote collaboration," said Rob Brazier, director of product for Twilio's Programmable Video platform. "Imagine if the next time you called your cable company, you could simply show them a video of the flashing lights on your cable box and they could instantly know what's wrong, and then guide you through the process of wiring it up correctly by overlaying the correct cabling on-screen in your physical space. The prospects for improving remote support and sales conversations is incredible."
Augmented reality startup Streem chose Twilio Programmable Video to power communications for their home services app, which is demonstrated in this video. The new Twilio Programmable Video capabilities will enable developers like Streem to create a wide variety of AR communications applications for consumers and businesses alike.
"As one of the first companies implementing remote AR, our unique challenges have required strong technical solutions. Twilio's top-notch team and products have met the challenge, and been nothing less than remarkable," said Sean Adkinson, CTO and co-founder of Streem. "With first-class support and collaboration from the very beginning, Twilio is instrumental to Streem's success, and they will play a large role as we continue to quickly scale and change the future of communication within augmented reality environments."
Some of the augmented reality communications uses cases that are now possible include:
Twilio's Programmable Video platform makes it easy to add real-time, multi-user audio and video communications to any web or mobile application. In addition to the new augmented reality APIs described above, Programmable Video supports both peer-to-peer and group rooms, enabling up to 50 participants to connect via audio and video. Twilio's Programmable Video provides SDKs for iOS, Android and JavaScript, and is based on WebRTC, the dominant industry standard for real-time communications.
Developers can learn more about Twilio's Programmable Video, download sample multi-user applications, and sign up at http://www.twilio.com/video/augmented-reality
About Twilio
Twilio's mission is to fuel the future of communications. Developers and businesses use Twilio to make communications relevant and contextual by embedding messaging, voice, and video capabilities directly into their software applications. Founded in 2008,Twilio has over 800 employees, with headquarters in San Francisco and other offices in Bogotá, Dublin, Hong Kong, London, Madrid, Malmö, Mountain View, Munich, New York City, Singapore and Tallinn.
Contact Information:
Contact:
Twilio Press