| AirPlay | |
| Developer: | Apple Inc. |
| Type: | Wireless media streaming |
| Logo Caption: | Logos of AirPlay 2 AirPlay video (left) and AirPlay audio (right) |
AirPlay is a proprietary wireless communication protocol stack/suite developed by Apple Inc. that allows the streaming of multimedia and device screens, together with related metadata, between compatible devices. Originally implemented only in Apple's own software and hardware, the company has since licensed the AirPlay protocol stack to third-party manufacturers and it has been implemented on devices such as television sets and home audio systems. AirPlay works through either a direct peer-to-peer connection between devices or through an infrastructure local network.[1]
In 2004, Apple introduced AirTunes[2] as a new feature of iTunes 4.6. It allowed music streaming over a network to an AirPort Express, which was equipped with a 3.5 mm analog-digital audio jack for speakers or other audio devices. In 2010, Apple introduced a new iteration of the AirTunes technology, now called AirPlay, as part of iOS 4.2. It supported audio and now video streaming to the Apple TV, and later added screen-mirroring and eventually support for a broad range of 3rd-party AirPlay-compatible speakers and AV equipment.
Apple announced AirPlay 2 at its annual WWDC conference on June 5, 2017. It was scheduled for release along with iOS 11 in the third quarter of 2017, but was delayed until June 2018.[3] [4] Compared to the original version, AirPlay 2 improves buffering; adds streaming audio to stereo pairs of speakers (e.g. stereo pairs of individual HomePods; AirPlay and its predecessor, AirTunes have always been stereo);[5] allows audio to be sent to multiple devices in different rooms;[6] and control by Control Center, the Home app, or Siri,[7] functionality that was only available previously using iTunes under macOS or Windows.[8]
| History of AirPlay | ||
|---|---|---|
| 2004 | Launch as AirTunes for iTunes and AirPort Express | |
| 2010 | Launch on iOS 4 as AirPlay | |
| 2018 | AirPlay 2 launch on iOS 11.4 | |
| 2021 | macOS Monterey (12) includes receiver capability on compatible Macs | |
AirPlay sender devices include computers running iTunes, and iOS devices such as iPhones, iPods, and iPads running iOS 4.2 or greater, and devices can send AirPlay over Wi-Fi or ethernet. OS X Mountain Lion supports display mirroring via AirPlay on systems containing 2nd generation Intel Core processors or later.[9]
In 2016, HTC released the "10", also known as "One M10", an Android phone with Apple AirPlay streaming.[10]
As of iOS 4.3, third-party apps like ApowerMirror,[11] AirServer, and Reflector may send compatible audio and video streams over AirPlay.[12] The iTunes Remote app on iOS can be used to control media playback and select AirPlay streaming receivers for iTunes running on a Mac or PC.[13]
As of macOS 10.14, there is no public API for third-party developers to integrate AirPlay 2 into their macOS apps. However, there are third-party streamers such as Airfoil. In May 2019, a third-party developer released a macOS app that can stream audio using AirPlay 2.[14] The app includes a helper tool called "AirPlay Enabler" that uses code injection to bypass restrictions to the AirPlay 2 private API on macOS.[15]
AirPlay receiver devices include Apple TV, HomePod, third-party speakers and the discontinued AirPort Express, which included a combined analog and optical S/PDIF audio output connector. Compatible devices can receive AirPlay over wi-fi or ethernet. Some open-source projects have reverse-engineered the audio part of the protocol, enabling any computer to be turned into an AirPlay receiver for audio.[16]
However, because not all third-party receivers implement Apple's DRM encryption, some media, such as iTunes Store's own rights-protected music (Apple's own "FairPlay" encryption), YouTube, and Netflix, cannot stream to those devices or software. On Apple TV, starting with firmware 6.0, the DRM scheme is enforced: devices without it cannot be used.[17]
AirPlay wireless technology is integrated into speaker docks, AV receivers, and stereo systems from companies such as Naim, Bose, Yamaha, Philips, Marantz, Onkyo, Bowers & Wilkins, Pioneer, Sony, Sonos, McIntosh, Denon,[18] and Bang & Olufsen.[19] Song titles, artists, album names, elapsed and remaining time, and album artwork can appear on AirPlay-enabled speakers with graphical displays. Often these receivers are built to only support the audio component of AirPlay, much like AirTunes.
Bluetooth devices (headsets, speakers) that support the A2DP profile also appear as AirPlay receivers when paired with an iOS device, although Bluetooth is a device-to-device protocol that does not rely on a wireless network access point.
During the January 2019 Consumer Electronics Show (CES) in Las Vegas, television makers Samsung, LG, Vizio, and Sony announced they would be producing sets with built-in AirPlay 2 receiving capability.[20] LG announced that television models that are AirPlay 2-enabled will include the 2019 OLED, NanoCell SM9X, UHD UM7X, and LG NanoCell SM8X models.[21]
In September 2020, Roku added AirPlay 2 support as part of the 9.4 update on select 4K Roku devices. In April 2021, the 10.0 update added support for more Roku TVs and Players.[22]
During WWDC 2021, Apple announced that macOS Monterey would include AirPlay receiver compatibility for compatible Macs.
AirPlay and AirTunes can work over a local network (LAN), through either Wi-Fi or Ethernet, or (since 2017) directly to each other using Wi-Fi Direct, allowing devices to connect without a central LAN.[23] This method of peer-to-peer connecting is now preferred by AirPlay, but Apple notes that the protocol establishes a connection "using the method that’s the most responsive".
The AirTunes part of the AirPlay protocol stack uses UDP for streaming audio and is based on the Real Time Streaming Protocol.[24] The streams are transcoded using the Apple Lossless codec with 44100 Hz and 2 channels symmetrically encrypted with AES, requiring the receiver to have access to the appropriate key to decrypt the streams. The stream is buffered for approximately 2 seconds before playback begins, resulting in a small delay before audio is output after starting an AirPlay stream.[25]
The protocol supports metadata packets that determine the final output volume on the receiving end. This makes it possible to always send audio data unprocessed at its original full volume, preventing sound quality deterioration due to reduction in bit depth and thus sound quality which would otherwise occur if changes in volume were made to the source stream before transmitting. It also makes possible the streaming of one source to multiple targets each with its own volume control, and for volume adjustments to be applied instantly, instead of being delayed by the 2 second buffer period.The AirPort Express' streaming media capabilities use Apple's Remote Audio Output Protocol (RAOP), a proprietary variant of RTSP/RTP. Using WDS-bridging,[26] the AirPort Express can allow AirPlay functionality (as well as Internet access, file and print sharing, etc.) across a larger distance in a mixed environment of wired and up to 10 wireless clients.
At WWDC 2011, Steve Jobs, then CEO of Apple Inc., announced AirPlay Mirroring as a feature in iOS 5 where the user can stream the screen from an iPad 2 to an HDTV wirelessly and securely without the need for cables.[27] [28]
AirPlay is a different technology from AirPlay Mirroring, as the former allows specific content formats to be streamed, while the latter allows the whole screen to be broadcast from a variety of iOS devices and iTunes to an Apple TV (2nd Gen or later). The exact composition of the protocols that AirPlay Mirroring uses have not yet fully been discovered, or reverse-engineered.[28] However, an unofficial AirPlay protocol specification is available.[29] Supported hardware (when using OS X Mountain Lion or later) includes any 2011 or later iMac, Mac mini, MacBook Air, MacBook Pro, or the Mac Pro (late 2013 or newer).[30]
When the protocol was known as AirTunes, it was reverse-engineered by Jon Lech Johansen in 2008.[31]
On April 8, 2011, James Laird reverse-engineered and released the private key used by the Apple AirPort Express to decrypt incoming audio streams.[32] The release of this key means that third-party software and devices modified to use the key will be able to decrypt and play back or store AirPlay streams.[33] Laird released ShairPort as an example of an audio-only software receiver implementation of AirPlay.[34] Soon more followed and in 2012 the first AirPlay audio and video receiver for PC came with a product called AirServer.[35] [36]
An open-source AirPlay mirroring server (receiver) known as RPiPlay is available for the Raspberry Pi and Desktop Linux operating systems. The author describes it as being based on dsafa22's Android mirroring server, which was in turn based on Juho Vähä-Herttua's ShairPlay.[37]
With Shairport Sync,[38] there is an implementation that supports AirPlay and parts of AirPlay 2 that runs on Linux and FreeBSD and works well on embedded devices such as Raspberry Pis or OpenWrt-powered routers.