How to real time, dynamic pitch shifting?

Post fully complete "how to" guides and tutorials here. This is a great place to get feedback on stuff you might put in the wiki.

Moderators: khz, MattKingUSA

ndani
Posts: 4
Joined: Tue Oct 26, 2010 7:52 am

How to real time, dynamic pitch shifting?

Postby ndani » Tue Oct 26, 2010 8:12 am

Hello everyone!

Autotalent is able to snap the input sound to the closest note, or to a scale, if it is adjusted.
VocProc can do something similar. But as I noticed, it somehow modulates togather the two signals. The output tone depends on the carrier's tone as well.

I'd like to make sing peoples who talk (on videos). But using VocProc, the vocie and carrirer inputs are modulated together somehow, so although the output sound is matching the carrier pitch, it has its "tone" too.

Both autotalent, and VocProc has pitch shifting features, but can only adjusted manually, not by the carrier pitch, witch would be best for me.

And then I realised, "autotune" is not the approperiate term for my goals, since I dont want to "auto" tune anything.

I'd like to pull an input sound to a carrier sound, which can be for example a sine wave.
My goal is to make sing talking people, by a keyboard for example.

Is there any pitch shifting solution which has two inputs? One for the sound to shift, and one for the reference signal to match? Preferrably jack compatible.

Thank you.

User avatar
Capoeira
Establlshed Member
Posts: 1178
Joined: Tue May 12, 2009 1:01 pm
Location: Brazil

Re: How to real time, dynamic pitch shifting?

Postby Capoeira » Tue Oct 26, 2010 8:21 am

use a real vocoder
there are some, lv2 and ladspa

also recently someone posted a howto-video here, think ot was autoStatic - search for it

User avatar
autostatic
Establlshed Member
Posts: 1728
Joined: Wed Dec 09, 2009 5:26 pm
Location: Beverwijk, The Netherlands
Contact:

Re: How to real time, dynamic pitch shifting?

Postby autostatic » Tue Oct 26, 2010 9:00 am

Hello ndani,

You could try the LADSPA Vocoder, but it is somewhat similar to the vocoder part of VocProc.

Tiny Tutorial: Vocoding in Qtractor

I think you will need a combination of a vocoder and an autotuner. AutoTalent is unfortunately not so good but Fons Adriaensen just released an autotuner (Zita-AT1) and it is simply top notch, love it. If you're using Ubuntu 10.04 I have packages available in my PPA.

Zita-AT1 Ubuntu packages

Best,

Jeremy
Last edited by autostatic on Tue Oct 26, 2010 9:37 am, edited 7 times in total.

ndani
Posts: 4
Joined: Tue Oct 26, 2010 7:52 am

Re: How to real time, dynamic pitch shifting?

Postby ndani » Tue Oct 26, 2010 9:17 am

Hello, thanks for the reply.

It needs libzita resampler... Could you put me in direction?

I've found the video that you linked, but it is the method I tried, and don't liked. The input voice and carrier is mixed togather somehow. Makes it too robotic. My goal is something like the Gregory's work: http://www.youtube.com/watch?v=44mqiBrB0zI

"The 'expected' pitch can be controlled by Midi" (Zita AT1)
This sounds promishing...

User avatar
autostatic
Establlshed Member
Posts: 1728
Joined: Wed Dec 09, 2009 5:26 pm
Location: Beverwijk, The Netherlands
Contact:

Re: How to real time, dynamic pitch shifting?

Postby autostatic » Tue Oct 26, 2010 9:33 am

ndani wrote:It needs libzita resampler... Could you put me in direction?
Yup, I have libzita-resampler packaged too: Zita-Resampler

ndani wrote:I've found the video that you linked, but it is the method I tried, and don't liked.
I understand, the video is about vocoding, not about extreme autotuning that you are after.

ndani wrote:"The 'expected' pitch can be controlled by Midi" (Zita AT1)
This sounds promishing...
It is promising indeed, I've played around with it and it's quite a precise and powerful tool.

ndani
Posts: 4
Joined: Tue Oct 26, 2010 7:52 am

Re: How to real time, dynamic pitch shifting?

Postby ndani » Tue Oct 26, 2010 10:21 am

Thanks for all your help.
I managed to make it work.
As I see, this zita really would do what I seek for. But not very well at the moment.
Maybe becouse of this: "AT1 does not include formant correction, so it should be used to correct small errors only and not to really transpose a song. "

If the input is a speech and a single note on the midi, it often slips out the tune, jumps octaves up and down.

It just work within one octave I think.

But the concept is right, i think, and its development is just begun.

ndani
Posts: 4
Joined: Tue Oct 26, 2010 7:52 am

Re: How to real time, dynamic pitch shifting?

Postby ndani » Tue Oct 26, 2010 11:06 am

I experimented a bit more.

The creators supposed, that someone who sings couldn't be as tonedeaf to sing one octave off. :)

In an actual speech the spectrum (or spectra in english?) can be much wider than this, that's make the glithces in the output.

IMHO

User avatar
Capoeira
Establlshed Member
Posts: 1178
Joined: Tue May 12, 2009 1:01 pm
Location: Brazil

Re: How to real time, dynamic pitch shifting?

Postby Capoeira » Sat Nov 20, 2010 2:40 am

AT1 is verrry nice
Autotalent and another ladspa wich I forgot the name i tried gave me unuable results but AT1 is really functional.
A shame that it can't be used as a effect directly in the DAW

User avatar
raboof
Establlshed Member
Posts: 1449
Joined: Tue Apr 08, 2008 11:58 am
Location: Deventer, NL
Contact:

Re: How to real time, dynamic pitch shifting?

Postby raboof » Sat Nov 20, 2010 8:27 am

AutoStatic wrote:I have libzita-resampler packaged too: Zita-Resampler


Cool. It entered Debian recently (nov 8), so that might flow into ubuntu too: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=600831

AutoStatic wrote:Fons Adriaensen just released an autotuner (Zita-AT1) and it is simply top notch, love it. If you're using Ubuntu 10.04 I have packages available in my PPA.

Alessio has been working on this one, too - looks like the package is finished and uploaded to the NEW queue, but not accepted into Debian yet (might take a couple of weeks): http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=600827

User avatar
Capoeira
Establlshed Member
Posts: 1178
Joined: Tue May 12, 2009 1:01 pm
Location: Brazil

Re: How to real time, dynamic pitch shifting?

Postby Capoeira » Tue Nov 23, 2010 2:20 pm

Capoeira wrote:A shame that it can't be used as a effect directly in the DAW


works perfect as an insert in Ardour

bigjuergo
Establlshed Member
Posts: 14
Joined: Thu Jan 21, 2016 11:52 am

Re: How to real time, dynamic pitch shifting?

Postby bigjuergo » Sat Nov 19, 2016 5:37 pm

I made a tutorial how to use the VocProc, maybe it helps you.

You can make very easy realtime autoshift with any midi instrument.
Best effects with saw signals (read description of the video for more details)
You can also use the VocProc as Autotalent

https://www.youtube.com/watch?v=4pgS29IyKFE


Return to “HOW TOs, Tips & Tricks”

Who is online

Users browsing this forum: No registered users and 2 guests