I am writing a web based app the requires real time audio manipulation, specifically a pitch shift in a users voice. For now my prototype uses GarageBand to pitch shift and soundflower to redirect the audio as my input audio source on the browser. Then using webRTC (simple webRTC library)I send a users web cam video and the manipulated webRTC stream to other browsers. This works great in Firefox but I have not had luck with chrome. The video channel is received fine but the audio is only silent on chrome. Any ideas ?
Related
I found this github repo which allows me to use WebRtc to deliver hls over the WebRtc Datachannel.
The Problem is that it does not support Safari on IOS.
The newest versions of Safari on IOS do support WebRtc datachannels and they have native support for hls playback.
This is my problem is it only possible to use WebRtc for data transfer on Browsers which support Media Source Extensions or can I also use WebRtc to deliver the .ts files to the Safari Browser on IOS?
I am a developer of P2P Media Loader and we are working on iOS support right now. Hopefully, we will have a prototype soon.
On iOS Safari you can exchange video and audio data using WebRTC Data Channels but you can not put that data and play into HTML video element without API like Media Source Extensions.
We are currently testing a different approach to do that on iOS Safari.
iOS Safari doesn't support Media Source Extensions of HTML5 video element.
Therefore, you cannot play synchronized audio and video on iOS Safari by any hand-made approaches that use various API such as Canvas, Web Audio API etc..
iOS Safari has two built-in methods for playing synchronized audio and video:
a. Native HLS playback
b. WebRTC PeerConnection
If you choose WebRTC PeerConnection, you will have to transcode AAC audio used in HLS to Opus audio required by WebRTC, and to transmux HLS to WebRTC.
Ugly, CPU-consuming and really pointless. What does it buy you? Why not to use native HLS playback on iOS Safari? But if you insist on option b, then there is number of software media servers that will do it for you.
I am building a PWA with Agora broadcasting API. I managed to get the video stream playing on desktop Chrome, but not on Safari. The documentation says Safari is supported on both MacOS and iOS, but it doesn't seem like the case.
When I opened the client page on Safari, instead of playing the video stream, it just create a video player without content. I don't see any data being streamed in the inspector view, or there isn't any activity going on at all.
Do I need to do something different with Safari?
Agora.io provided an auto-diagnostic page for their Web SDK, which may be useful for you:
agora_webrtc_troubleshooting
I want to create a video chat with WebRTC, but i have no idea about this. I need my own WebRTC server to establish a video call from a PC browser to another browser on PC or on android device, how should I do?
Luckily we live in 2018 where most of the stuff already implemented. There are bunch of WebRTC Video Chat providers that provide API, SDK and docs for integration.
I used ConnectyCube in many of my applications. They provide WebRTC Video Calling functionality for iOS, Android and Web(JS).
iOS WebRTC (video chat) guide https://developers.connectycube.com/ios/videocalling
Android WebRTC (video chat) guide https://developers.connectycube.com/android/videocalling
Javascript WebRTC (video chat) guide https://developers.connectycube.com/js/videocalling
WebRTC features supported:
1-1 video chat
Group video chat
WebRTC based
VP8/H264 video codecs supported
Mute/Unmute audio/video stream
Switch video input devices (cameras)
Video recording
The whole list of supported features
Highly recommend to try something like this and do not waste time on implementing everything from scratch by yourself.
How to disable video streaming while video streaming is already invoked? Like in Facebook Messenger, it can turn video call to voice call only.
At the moment, you'll have to tear down and recreate the whole connection with audio only, as Kurento does not support renegotiation. We are working on it, though!
UseCase - I am using android projection API to capture my android device screen. The output is displayed in a SurfaceView. Next i want to project surfaceview data to a web browser using Webrtc.
I have seen lots of example which uses device camera and stream it output to web browser. how can i stream a video being played on surfaceView/TextureView to web browser.