Music
project example
features
devices
use cases
costs

Software Development for In-Sync Music Jamming Online by Video Chat

project example
features
devices
use cases
costs
project example

WorldCastLive

Example from Fora Soft: musicians can survive the pandemic with WorldCastLive.com. The band connects in a video call, invites the fans to watch, and they jam online remotely at a live concert. 100% in sync, with less than a second delay.
View project

Features

Audio quality šŸŽ¶

Clear sound: right audio codec with right settings
In WebRTC the developer picks an audio codec. Some are better for voice, some for music. Choose Opus: the best sound quality plus low latency ā€“ Mozilla thinks so too.

To pick Opus is not everything. By default, WebRTC is set for voice calls so that the voice would sound clearer and louder. So, for music jam online in real time we need to make 3 adjustments:
  • Background noise removal distorts sound when playing music. We switch it off.
  • ~40 kb/s is a standard bitrate for a voice call. Music needs 128 kb/s minimum. Opus supports up to 510 kb/s ā€“ so we increase it.
  • We increase the number of audio channels from 1 to 2: from mono to stereo.

Synchronization ā±ļø

Why not make music online with friends and strangers in any video chat? I take the guitar, call Joe with drums, add Sarah with a piano, and we all play. Because it doesnā€™t work: participantsā€™ sound is not in perfect sync. Itā€™s ok for a talk but not for a real time video music collaboration app.

We develop video conferences for musicians to play together, learn and teach, and hold concerts.
Sync for listeners
Each musician produces an audio track. Our software marks them, recognizes delays for each one of them, and syncs them into one audio file on the server. Itā€™s streamed to the audience.

But if this happens afterward on the server, how can the musicians perform together? They have to hear each other in sync right now to play together.
Sync for the musicians
We calibrate audiotracks: start sound at one node, and listen to it when it reaches the other node ā€“ thus measure the delay. Letā€™s imagine we have a drummer, a guitarist, and a singer. The drummer starts, his audiotrack goes to the guitarist. The guitarist starts, the 2 audio tracks go to the singer in sync: the delay is added to the drummer track with which it goes to the guitarist. It snowballs from there: each next musician hears the previous musicians only. The singer hears the guitarist and the drummer, the guitarist hears the drummer only, the drummer does not hear anyone.

Real-time streaming šŸš€

Jam online with no latency
Subsecond latency is a norm in video chats ā€“ otherwise speaking to each other would not be possible. In video broadcasts to thousands of people, a few-second latency is a norm. When jam online with other musicians remote by a video chat, latency must be subsecond even though thousands are watching. Read how we do it in the article.
Monitoring to prevent latency: Internet connection, sound card, audio output
See the sound quality of each musician in real-time: green for good, yellow for decent, and red for unacceptable. Quality parameters: Internet connection, sound card latency, audio output.

For example, if one participant has slow Internet, the video conference wonā€™t be real-time and low latency music collaboration is not possible. So his Internet shows red, and the slow user knows that he needs to fix the problem.

Connect professional musicalā€ØequipmentĀ šŸŽø

Output: sound cards and audio interfaces
For sound output, connect a sound card or an audio interface for professional sound. Show a volume bar for that output that displays volume in real-time.
Input: professional microphones, musical instruments, and amplifiers
For sound input, connect a guitar or other electronic instruments directly to the video conference. Or connect the instrument to an amplifier to increase the power of a signal and plug the amplifier in the conference. See the inputā€™s signal level change in real-time.

Professional tools for musicians šŸ„

Crossfader
Set different volumes for different audio channels. Make your own instrument louder than the call, set it to the same volume, or listen to the call louder than your instrument. Mute audio channels.

See the volume set for each instrument in the music jam over the Internet. The range can be from (-12)dB up to (+12)dB with a step of 1 dB.
Equalizer
A list of ranges with sliders to raise and lower the volume of the frequency range between 32 Hz, 64 Hz, 125 Hz, 250 Hz, 500 Hz, 1 kHz, 2 kHz, 4 kHz, 8 kHz, 16 kHz. Change how everything sounds: sound volume, noises, the effect of moving closer and farther. Remember the settings and apply them to other calls.
Metronome
Add a metronome and choose BPM for better music collaboration.

Communication tools šŸ’¬

Direct messages
"Crescendo here! And now, pizzicato!" ā€” the group coordinator can comment on the musicians' performance during the live concert, addressing each one separately to avoid disrupting the others. Press the button to start speaking and release it to turn off the sound.
Text chat
The audience can also communicate with each other. Send text messages, emojis, images, and even documents. You can also view the list of participants.

Recording šŸ“¼

Record the concert and let those who havenā€™t seen it live watch it. Record lessons to re-watch.

Devices

We are developing software for web as well as apps for PCs, tablets, mobile phones, and VR headsets.

Use cases when a video conference with music in sync comes in handy

šŸ§‘šŸŽ¤ A platform for online virtual concert live with high-quality sound and no latency
šŸŽ¼ Online band or choir rehearsal with remote musicians from different locations
šŸŽ§ E-learning for music
šŸŽ™ļø Virtual karaoke party online

Costs

We develop custom applications tailored to your needs. Therefore, our process begins with drawing up a plan, designing a clickable prototype, and then providing you with an estimate. Only after this can we give you rough numbers for development ā€” we don't know exact pricing and timelines in advance. However, here are some approximate guidelines:

The simplest 1-on-1 video chat component adjusted for music

~ 2ā€“4 weeks Ā· $7,000
It is not a fully functioning system with login, payment, etc. ā€“ just the video chat component. You can integrate it into your application.

The simplest video conference component for musicians from different places to perform for audiences of thousands of people

~ 1,5ā€“2,5 months Ā· $28,000
Not a fully functional system with registration, payments, etc. ā€“ just the video conference component. You can integrate it into your solution.

Simplest fully functional e-learning system with 1-on-1 video chat adjusted for music

~ 3ā€“4 months Ā· $36,000
A fully functioning system with registration, teacher list, payment. Applicable for 1 platform, e.g. web, or iOS, or Android.

The simplest fully functional video conference system with music in sync

~ 4ā€“5 months Ā· $54,000
It is built from the ground up for one platform, such as web, iOS, or Android. Users register, pay, and play music together for audiences of thousands of people.

Big musical video conferencing solutions

We assign a dedicated team and work ongoing. These are products that proved their success and generated profit.

Have an ideaā€ØorĀ needĀ advice?

Contact us, and we'll discuss your project, offer ideas and provide advice. Itā€™s free.
WhatsApp usFill in the form

Telemedicine

Have an idea?
Leave your request, and we will give you a call to discuss project details and estimate its cost. We will provide initial requirements for free, recommend technologies, and offer an assessment.
Fill in the formBook a callWhatsApp us
+7 (852) 8193-2621
Hong Kong
+1 (718) 487-98-36
New York Ā· USA
Describe your project and we will get in touch
Enter your message
Enter your email
Enter your name

By submitting data in this form, you agree with the PersonalĀ DataĀ Processing Policy.

Your message has been sent successfully
We will contact you soon
Message not sent. Please try again.
WhatsApp us
Book a call