The open source Android Mirroring App Scrcpy 2.0 adds audio support

The open source Android Mirroring App Scrcpy 2.0 adds audio support

Scrcpy is a cross platform an open source mirroring app for Android devices which connects via USB or TCP/IP to control connected devices via keyboard or mouse.

The best part of using this app is that; that does not require root access On Android devices and does not display ads or collect your data 😄

🗒️

Scrcpy stands for “screen copy”.

Recently, lead developer Romain Vimont announced the release of Scrcpy 2.0 with some new additions.

Let’s take a look at it.

🆕 Scrcpy 2.0: What’s New?

screenshot of Scrcpy 2.0 running on Ubuntu 22.04
Screenshot of Scrcpy 2.0 running on Ubuntu.

The main highlight of this release is its introduction real-time audio streaming on Android 11+ devices.

What is that?: This is a new addition to Scrcpy that allows you to stream and record audio from your connected Android device to your host computer without any noticeable lag.

This was the most requested feature since the first version of Scrcpy five years ago, and now it’s here.

The lead developer experimented a lot, initially with development USB audio as a solution, but performed quite poorly.

Then he switched to a new prototype called sndcpy‘, an API to record audio from an Android app in Android 10. Unfortunately it is there were some unavoidable problems which caused it to malfunction.

Luckily back in January a Scrcpy user ‘yume-chan’ secured Romain a proof of concept for recording device audio with shell permissions On Android with a functional solution for Android 11.

Since then, Romain has been busy integrating new features into Scrcpy.

How It Works?: It uses Android’s low-latency friendly API called “AudioRecord” to record audio, the “MediaCodec” API to encode the recorded audio, and a new “Audio Player component” to feed the audio output with very low latency.

See also  These are the best CarPlay apps for EV owners

Additionally, audio and video streams are demuxed into packets by a “demuxer‘.

Romain also shared the useful client architecture flowchart which shows how video and audio streams are handled on Scrcpy 2.0 if you’re interested in the technical details 🤓

scrcpy 2.0 client architecture

What devices are supported? 📱

On Android 12 and newer systems, the audio streaming function it works out of the box. However, with Android 11, you should unlock the screen when starting Scrcpy for successful audio recording.

On the other hand, for Android 10 or earlier sound cannot be recorded at all.

In addition, Scrcpy is now available H.265 and AV1 encoding supportprovided your device supports it.

To learn more about how the new audio streaming feature works on Scrcpy, check out the official announcement blog post.

📥 Download Scrcpy 2.0

Packages are available for Linux, macOS and Windows. You can get them from GitHub.

For installation instructions, see the instructions on GitHub to set it up successfully on PC/Mobile.


More from It’s FOSS…

You may also like...

Leave a Reply

Your email address will not be published. Required fields are marked *