I Fixed The Major Problem With All Software Synths
Vložit
- čas přidán 4. 11. 2022
- I've invented a new way to control software synthesizers and VST plugins. In this video I will pitch the concept to you, and explain how it could revolutionize the way we use USB MIDI keyboard controllers when playing synths, using effects and making music in our DAW.
MORE WOODY PIANO SHACK
► PATREON bit.ly/woody_patreon
► CHANNEL MEMBERSHIP bit.ly/join_wps
► WEBSITE woodypianoshack.com
► PIANO INSPIRATION SERIES bit.ly/inspiration_welcome
► SUPPORT bit.ly/wps_support
► CHAT bit.ly/discord_woody
► TWITTER / woodypianoshack
► INSTAGRAM / woodypianoshack
► FACEBOOK / woodypianoshack
► TWITCH / woodypianoshack
► MUSIC woodypianoshack.bandcamp.com
Hall of the Mountain King by Kevin MacLeod is licensed under a Creative Commons Attribution 4.0 license. creativecommons.org/licenses/...
Source: incompetech.com/music/royalty-...
Artist: incompetech.com/
#synth #vst #musicproduction - Hudba
Novation’s Nocturn did this with its “Speed Knob”. That came out almost 15 years ago.
But it used a scroll wheel emulation with really bad resolution so it sucked
it was called the Speed Dial and it was on the SL keyboards too... I remember using it quite a lot
Yes I miss that so much. Automap is old, I just wish we could do this with any controller.
This is actually a feature in Studio One, named "Mouse Over". It does exactly what you describe here.
Cubase 12's new MIDI Remote Manager lets you do this with any controller. You can assign a control to "Value at Mouse Pointer" and the controller you've assigned will change the value. I've just tried it with a Novation Impulse 61 and some plugins and it works quite well mostly. This might be down to the plugin maker though as to if it works or not because the Triton VST doesn't respond to it but other plugins do.
Wow! Gonna try that with Cubase 12 (Which I also own) and the Behringer FCB10101 foot controller, which has two expression pedals among other things. Just assign the pedals to the knobs/sliders and then you have one hand free to play on the keyboard and then use the mouse with the other hand and turn the knob/slider with the foot!
That sound really great. Maybe You could try to make some video tutorial how it works and how to set up to work like that? That would be very helpfull.
Not sure why hover activation is already a thing. I always wondered why it wasn't. Glad you are pitching the idea.
Interesting commentary Woody. Love your enthusiasm for synths. The world has now arrived for us to go anywhere we want without too much outlay in synths. The choice is overwhelming. I agree with your thoughts concerning the difficulty of computer synths.
For my preferred DAW (FL Studio), there's an Android/iOS app (IL Remote), that allows you to set up custom MIDI controls. You can then setup a generic page of controls for things like transport controls, channel select, tempo etc. as well as VST specific ones where you can add virtual knobs/faders that match the layout of the VST in question. It's not ideal, but it's a good compromise between hands-on control and flexibility. Pretty similar to your touch-screen point!
I couldn’t agree more with the premise of this topic! Muscle memory is a real thing and as musicians we don’t want to think twice about our instruments in the long run. FWIW, my current hope is that the MPC key 61 - which has a big knob by the way - will give me the mapping and muscle memory with a few of the better plug ins they have, such as the Mini D and the OPX4.
MPC Key 61 also has a big slide touch that can serve as a fader control, but I haven’t really worked with it much.
Nice idea, the “control on hover” functionality part anyway - not sure a single external box with one fader and one knob is any benefit through. For me, if you’ve had to move the mouse there and your hand is on it anyway, just use the scroll wheel while your hand is on it. Or, build a “CC Mouse” that somehow has a knob and slider built into it.
Cubases CC121 controller does this -- its a motorised fader and works very well
You can already accomplish this with Audient iD series audio interfaces. Press the iD button on the front and you can use the wonderful giant clicky encoder knob becomes a scroll wheel to adjust anything assuming the plugin works like you are describing. Just hover the cursor, then spin the knob. Most of my plugins work, but it doesn't work with any of the arturia plugins. People have been asking for the hover and scroll functionality from them for a while.
You read my mind! problem wise.. solution wise I go a different way ( in my pipe dreams and possible future product project ideas, ) but kudos on you for tackling the basic killer problem regarding plugins vs hardware
Most of the controls are adjustable using mousewheel so I would take guts of a computer mouse and wire the big knob instead of mousewheel :) I believe it could be done using endless rotary knob. Not sure about the fader but hopefully it could be done as well.
That's actually pretty cool. I'd certainly go for something like that.
Great idea and relatively easy to implement!
Steinberg did something similar with AI knob which is included in some of their controllers and audio interfaces, but a universal solution could be nice
interesting, i did not know that, obviously! but yeah, all vendors would need to implement the "hover-to-activate-control" feature.
The Novation Nocturn did exactly this.
The AI knob function can be performed by any MIDI Controller in Cubase 12.
I was trying to remember who made this just the other day! Was actually thinking exactly the same thing - I want just one good quality knob and maybe transport and a slider...
Good idea. The Novation MKII SL keyboards have this and I have used it a few times it's the 'speed dial'. It works as the mouse scroll wheel so only synths and effects which respond to this will work.
I think I would prefer one hand operation, and select the software control by pressing left/right/up/down buttons before adjusting the value with the Big Knob. For this to work really well, the software controls would have to be arranged reasonably linearly, e.g. virtual knobs arranged in a circle would be a bit of a nightmare with this method. (Apologies if this has been suggested already.)
Nice idea Woody!
Solid concept! I have a feeling one could achieve this with ReaLearn in Reaper... if you click the control first, it can probably be a native action. Now I've gotta try some things!
Bravo!!!! That's a great idea!!!!
Elephant allows you to do this with the Surface Dial. They were also talking about supporting the Logitech Craft keyboard.
Both the Ableton Push and the SL MK3 map the last tweaked parameter to the first encoder, allowing you to get this functionality after clicking the parameter you want.
Great idea!!!
Great idea. I'd get one if it was made 👍
Cool idea! I would also add a few pushbuttons to toggle between different modes of operation. It wouldn’t be too different to design from a hardware standpoint, just a simple microcontroller that can emulate a mouse. The software side would be the hard part, developers would have to support it (having it in the formal VST spec be the best way to encourage developers). Maybe something is possible with an Autohotkey script for VST’s that don’t support the behaviour from them selves.
A simple but great idea!
Steinberg's AI knob... the CC121 has it as well as the now discontinued CMC series. The new midi mapping in Cubase will actually let you do it now with any controller. You have an AI knob which adjusts under the mouse wheel and a lock key to lock the value so you can move the mouse without loosing control. It's a nice idea but in practice (I've used both the CC and generic options) it was usually quicker to just use the mouse. Only the rare occasion where I wanted to record certain automation data live that I ever used it.
Sure, I have cubase and it's hard to do timed effect sends with a mouse -- the controller becomes vital
Great pitch! I'm a developer and I did a 5min quick proof of concept of this idea, it works! Positioning the mouse and sending scroll events (and / or mouse drag events) triggered by a normal midi controller. And all can be done in a simple python script. I'm very excited to give this a try
you're the man, respect!
I like your thinking Woody. Have you heard of the "Nektar" range of keyboards and midi controllers? Although their keyboards/controllers only work with certain DAW's, they have multiple rotary and sliders, that via their software automatically map to the DAW's instruments and fx. Also they have the various parameters printed onto the controllers knobs/faders. . I believe that you can even create and save your own CC mapping..
Great idea, a trackball works well it doesn't dart as much as much as a reg mouse and has a nice circular scroll wheel. Will let you know if System 8 works as a master keyboard, it should automap to every parameter hopefully in Roland Cloud
I think a foot mouse or trackball would marry very well with your hover controller!
Excelent idea 💡!
I've seen some pretty impressive demos of eye tracking software, wonder if you could pair them so you wouldn't even need to touch the mouse, just look at what you want to adjust and move the knob 🤔
Actually Push 2 + Ableton Live did it already very well with all third part plugins. It's a trick that I already use for Arturia synths for instance. Because I totally agree with woody, midi mapping is simple but a pain stack to do it with all parameters of one virtual instrument and we have a lot today. I found out also that third part FX processors plug-ins parameters from this brands are fully handle by Push 2 without any configuration : Native Instruments, Soundtoys, Valhalla DSP, Eventide (H9 plugins). Of course stock plugins from Ableton are totally map on push2, likewise for Native Instruments collection and Komplete control or Arturia and Keylab controllers.
Another super-helpful video, Woody! Nice work. 12 years ago, Novation did this with the Nocturn... the middle knob. Whatever the mouse was hovering over, it would control (poorly-- the resolution wasn't great and it was more of a mouse scroll wheel substitute). They called it the Speed Knob. I still think this is insanely useful, but sadly the Nocturn is something a lot of people hated because of the "Automap" thing. But, the Speed Knob had nothing to do with Automap. Something to think about... this is entirely possible though, especially with Reaper, which I know you use and love. Maybe with the ReaLearn2 plugin by Helgoboss.... seems a lot more powerful than the original.
Novation wanted an ecosystem that was proprietary to their 'automap' products like the Nocturn and SL keyboards. Native Instruments are trying to have their own proprietary ecosystem with Komplete Kontrol. Before that they tried with Kore.
The thing is, for such ideas to be successful they have to be ubiquitous, like keyboards and mice. They have to be general purpose, not just for music software. And to be ubiquitous, the need to be free and open. Otherwise they'll be niche at best, and likely something that failed in the market and died, like Automap.
At least the Nocturn provides raw _relative_ midi CCs, so you can translate those to other things in software.
Absolutely brilliant. No more needs to be said.
Great idea Woody. That’s thinking outside the box, or rather the mouse! How about an entire computer keyboard with assignable knobs and sliders instead of QWERTY characters and also a trackpad incorporated for moving the cursor?
Thanks to the ease of arduino ide and PieterP's helpful control surface library I was able to built an arduino prototype for (EDIT:something similar to) this changing only a few lines in the tutorial example code for a bankable knob.
Hooked up two pots to analog pins A0 and A1 (on the pot wipers, the other two pins on 5v and ground, of course)
Instead of defining the bank as Bank bank(3) or whatever they had in the code it's just Bank bank(1)
the first knob controls what cc number the other does
HI, just been watching your video with interest, wouldn't it be feasible to have the knob and slider on a mouse itself?
If the hoverknob is of the right size, it could also control the cursor- rather than using a mouse additionally. Now I have improved the idea... can I have some shares when you patent it?
It`s a good idea for software SYnths. I think that I could already do something like this using a `Spinner` device that I built for one of my ARcade Machine builds. Basically turning the SPinner knob only moves the mouse cursor through one axis, horizontal or Vertical. The Computer sees the SPinner as a type of Mouse and you can typically assign a couple of `mouse` button controls to it, if the button for the left mouse control was latching instead of momentary then it would also be like holding down the left mouse button without having to do so if you wished to do that too. Now you can`t buy a ready made `Spinner box` assembly, they are either buildt into an Arcade Machine`s front panel or you have to build your own into a project box like I did and then attach it to the computer via USB. This idea only works of course when the mouse action required to turn a knob is just up and down but I think that most of the software Synths are like that. So in the end you can navigate the software synth with both hands : A trackball or mouse in one hand and then a `spinner box` in the other and no need for any midi CC`s etc .......
Also, click and drag over two controls to map to both controls. Or generalize to a multi knob / fader controller, and drag over all the parameters you want. On the controller there could be a small OLED screen like on the Akai Fire that would automatically update with the name and value of the parameter.
That is indeed a very good idea! Just click 4 knobs in the software and they are automatically mapped to 4 hardware knobs that also display the name of the software control they are mapped to. There is really no end to this line of thinking.
I'm a Cubase user and I have the (recently discontinued) CC121 controller from Steinberg. Is has the knob you're talking about! It works with all Steinberg plugins but also with some 3rd party plugins, like Dune, Toontrack stuff, Omnisphere, PG-8X, TAL U-NO-LX, FM8, Massive and possibly many others. Unfortunately not all. But I do hear you Woody! One Knob to rule them all!
It's a good idea actually, I can see me using it :)
Hover control sounds good but it requires your dominant hand to move the mouse and your other hand to adjust the knob, leaving you without a free hand to actually play the keyboard.
I don't mind using MIDI Learn if I make temporary sticky labels for the knobs/faders. I don't recall Logic Pro ever forgetting learned assignments after reloading a project, though that might be caused by bugs in a particular plugin.
I was trying figure that out also you still have to move the mouse
I love this. You can sort of “brand” it with that name and then badger all of soft synth companies to support it.
Another thing that annoys me is that you can’t change patches with the arrow keys on the keyboard and some don’t respond to program change.
In the old days of computing (specifically Mac from what I know) and hardware there always at least ways to do most of the most common functions. For example, top menus, key command, or long click/double click/right click.
Check out the NOB controller. It can adjust any type of parameter on the screen (hoovering over it with the mouse) with a precise and versatile knob.
its a great idea for in studio daw work. for performing musicians, we do need something that is pre programmed and we are not looking at a screen to hover over something to control it. we just need a dedicated knob that just works.
try unify 1.9 which is a synth as well as a vst or AU wrapper that can host multiple synths from multiple manufactureres and you can program 1 knob to control any parameter on any synth on any layer simultaneously. for example, you could control the filter cut off on an Arturia Juno on one layer, another filter cut off on an omnisphere, a pulse width modulation on another synth on another layer, etc. just by turning one knob.
I've sent this exact idea to the developers of Cubase and Logic circa 8 years ago. The important factor being that you select a knob that you already have on an existing controller which the DAW default to. That one knob then acts like your mouse wheel. ... like you explained.
Perhaps this has already been suggested, but maybe the hover knob can be a mouse also? Perhaps you can have a small knob that can move the mouse cursor over the parameter that you want to control? 😊
Hovering with the cursor is sometimes already available in some programs. Nonetheless, I really like this innovative approach you have presented here. It can make your viewers want to interact. Brainstorming for idea development could have great potential in social media. That could lead to more crowdfunding. One idea to take this further is for the music industry to participate and contribute to the development of eye tracking. It is of great benefit to the disabled. This means that it is enough to look at the knob or the fader, after which a reading is made of what is on the screen you are looking at. You can then use a suitable controller. In this case, it would be both faster and easier than reaching over a control panel to reach various controls. you can use one and the same for everything.
I don't know if you can still them but there is a computer mouse similar but has a ball scroller that sits on top of the mouse base. And you toggle with your fingers . Track wheels I think there called. But a tweak on the item itself probably wouldn't go a miss. Loving the idea concept proposed here.
Woody, I enjoy your videos! Have you tried scrolling your mouse wheel while hovering over a control knob?
There's already TouchOSC, you can design your own controls.
And I guess if you're using a trackpad or Apple magic mouse, it's already figured out.
If plugins synths sounds equally or better please show me which plugin sounds like Moog One. Im really curious. Thanks. I agree that plugins sounds really good. But they are really weak on couple things.
This can be done with the Microsoft Surface Dial. The knob has a nice feel to it too 👍👍
I do the exact same Woody! I hate mapping over and over again
great idea 😁👍👍
Woody, I believe I have the solution to this problem. Its a piece of software called Bome Midi Translator Pro. I got it bundled with the Bomebox, a really nice device to translating/modifying midi signals between devices. But you can buy and use the software on its own, which I do more than I use the bomebox. Its a robust and flexible way of modifying midi signals in all sorts of ways. And it can handle computer keystrokes and mouse movements to. I've just had a go and took 15 minutes to write a program that does exactly what you want - I hover over any synth control and can modify it with my choice of twiddly knob or slider. Excellent idea, I shall add it to my existing midi projects. Feel free to get in touch if you want to discuss further.
This has been around for a while, Studio one for example has this feature which I use with their fader port.. mouse over anything and you can use the knob to control.
I also do that with my Faderport V2. That is one of few things I use the Faderport for nowadays.
Good idea! And maybe also pushbuttons to the left and right to select previous and next control, without need to move "knob hand" between knob and mouse or touch screen.
Basically, a MIDI controller like my NI M32 has 32 keys (which could also double as buttons), a number of buttons (which do nothing _except_ with NI's KK software), and 9 knobs (8 of which can generate MIDI). If you think at a raw level, you have things which produce relative change data (+n/-n), like a mouse axis, and things which generate 'button down'/'button up' events, possibly with velocity. There are myriad possibilities for what meaningful thing those buttons and knobs do, if only there was a free, open, standard way of routing the change and press events to things.
I've commented elsewhere, but why restrict things to music applications only. Knobs could just as easily control things like stroke width in Inkscape, or brush size in Gimp or Krita, or rotate the viewport or objects, or many other things in Blender. For me, thinking only in terms of music software applications is very short-sighted and limiting.
Hi Woody. Have you tried out Gig Performer? It is brilliant for customisation..very easy to do all manner of user mapped configurations etc..perfect for live playing. Once it is setup you don't have to touch the mouse...any midi button can do anything you need. But I do think the idea you've mentioned would be great too. Thanks.
I use the Steinberg CMC AI and have been using it for years. It's a shame they discontinued the hardware, but it still works. I still prefer a synthesizer to control softsynths and it works very well for all the basic controls I use the Prophet 08 and also the REV2.
We can also use the steering wheel of a car as a midi controller, or even better a ship's steering wheel in order to get a high resolution of changing parameters
Yes yes yes! Someone please build this!
I have a better idea : using our voice to choose a parameter like filter, cutoff, etc. and then moving the knobs and sliders. So no more mouse movements, only voice control over all parameters in the vst. Future will tell.
Great idea, when will we be able to buy Woody's knob?!
This concept works în Vcv Rack already. Indeed it is very handy
I've never really had an issue with mapping real-time controls of soft synths to my MIDI controls, and I'm always puzzled why so many others have an issue with it or still seem to think they are required to use the mouse to control their instruments.
I believe it was back in 1997 that Bitheadz software made me aware of "MIDI CC" known as continuous controllers. I had their great (for 1997) analog synth program called Retro AS-1 I ran on a Windows laptop (also available for Mac). They told me Price replaced his Oberheims with it. As only some newer keyboards at the time came with a lot of MIDI CC knobs or sliders, they suggested I purchase a KeyFax Phatboy controller which they supported which was a small box you could place on top of a keyboard and it gave you 16 MIDI CC real-time knobs. It had cost $250 at the time. I took their suggestion and it worked fine. It even included some overlays you could throw on top and if you wanted to label each of the 16 different controls differently, it was pretty quick and easy to change for use with a different soft synths. I still have mine in storage.
For many years now, I use my Axiom 61 which has 9 sliders & 8 knobs plus some buttons. I also generally gig with at least 2 keyboards, so there are a few on my other keyboard/s too if I need them. In addition, I can always also setup my Korg Nano Kontroller which provides a bunch more knobs, sliders & buttons that could also be setup, plus my older Phatboy which works by connecting to MIDI rather than USB. I don't think I'd ever be short on the number of knobs, sliders or buttons vs what a hardware synth may have. It's also possible to have more than one keyboard playing the soft synth, utilizing the knobs, sliders & buttons on the other keyboard at the same time.
I've found the easier thing to do is to assign common parameters to the same controls in various soft synths. Things like the filters, portamento, volume, attack, release, etc etc should be setup the same in each synth. Then you only have to memorize your most commonly used controls, and it's really not too hard. It's the more advanced programming stuff where you'd need a lot more knobs.
I have MIDI CC real-time controls I probably setup 20 years ago that still work perfectly fine. It's true I've seen a few files not respond correctly here and there, but generally speaking it's pretty solid. Certainly no less reliable than than vintage analog synth would be, which are known for breaking down and frequently in need of service. Even many modern analog hardware synths need to be serviced fairly often compared to digital synths.
It really just comes down to the labeling that I think could use improvement. I think way too many people have turned something that isn't really that complicated or that big of a problem into something more difficult to deal with. Most of us use computers on our job already. Really it's just a matter of having some decent computer skills and understanding how our hardware keyboards work. If people can figure out a hardware synth and how to write comments here on CZcams with their computer, they should be able to figure out how to map real-time controls.
The biggest justification I have for hardware synths over software is "the fun factor". I prefer editing some sounds using a computer anyway. As for sonic ability, cost, storage or portability, software can't be beat.
This is indeed a very good idea, especially in combination with the touch screen that you mention. Hopefully software manufacturers do pick this up. Though It reminds me a bit of computer keyboards that after all these years still don't have dedicated copy and paste buttons. The easiest things might prove the hardest to get done, sadly.
I wasn’t excited until you broke out the colored Sharpies. Device definitely has to be in brilliant dayglo colors now.
yes yes, hardware manufactures, let me desigh the color scheme. pretty please!
I have researched this and tried audient solution but it has the same stepping as a regular mouse so it was not useful for me. The NI Kontrol approach is interesting it solves that even without mouse but still feels like an additional layer. The problem with the mouse or audient approach seems to be more on the software level, the computer OS mouse interface is in charge of passing the movement on the screen GUI information then to the Plug-in/DAW, but the wheel control part seems not designed to pass a real time detailed knob data. So the solution involves the OS manufacturer I think.
I like the idea.
Right now I'm using a trackball, so there is no need for sliding. It is somehow better than the mouse because it stays in the
same spot, and moving the cursor with one finger is way easier ( for me ) than having to drag my hand over a surface.
I was never able to get the same precision with the everyday mouse.
Such controllers exist, they are used for drawing or video editing, they have a relatively big knob/ wheel with a precise movement and they are priced accordingly. I was thinking to get one, but the trackball does a fine job for me.
I’ve had the same idea. I don’t have a controller with a lot of knobs so I have thought about using the modwheel for that purpose. We need pester our favourit software companie with this request to make it happen. I read in the comments that some software have this function, but it would need to be universal I think.
"Volatile Link" in FL Studio does something similar. I have a specific knob on one of my controllers set as the volatile link knob. Any parameter anywhere I click on it adjusts via this knob.
I sort of do this now with an Apple Trackpad. I have "three-finger drag" turned on. I just move the mouse cursor over the control with one finger, then slide three fingers up or down to move the control. Feels like moving a little invisible fader in a way. it's still nowhere near as satisfying at turning knobs on a hardware synth, but it's a step up from mouse clicking and dragging. The thing I don't like about the Hover idea is it requires two hands, whereas, the trackpad only requires one. All that said, I'm down for any innovative idea to help software synths be used more easily. I only have two hardware keyboard/synths, and tons of software synths. In many cases I prefer the sounds on my software synths, but I still use the hardware way more because of the better real world connection with them.
It would be a good project. The Arduino Leonardo is a good dev board for this, it can be seen by the host OS as a keyboard and mouse.
This idea was offered as a solution from 2017 NAMM called Kontrol Master. I had one. It is great ergonomically, but they made the software dependent on a server that was shutdown after the product failed.
So, it's in a land fill now.
I think that something with either a usb macropad with a knob or the $20 usb volume controllers on Amazon combined with the Windows macro software AHK may be able to do what the Kontrol Master did.
First, just as you described, I was very dissapointed with soft synth/mouse experience.
Then I bought Push 2 which has 8 knobs and also buttons to switch banks of parameters. Tweaking knobs is good, but this time I hadn't enough visual feedback on what I tweak. Had to look at computer screen too often. On the push display I can see only 8 parameters at once, not the whole thing. Also, not every parameter can be controlled with knobs. Some things simpy can't be done with knobs like assigning a modulator to a parameter or connecting modules to each other in a modular environment etc.
Last week I bought a laptop with touchscreen and, man, I'm happy so far. Kind of getting the best of both worlds. Tweaking parameters on a touchscreen is way better than with a mouse. And I can see everything at once. All the actions work just like with mouse. The screen is only 13'' so I keep it closer to myself than my main 27'' monitor. It has kind of new 'synth at my fingertips' feel. I use Bitwig. It provides fantastic touch support. Yeah, I can tweak two parameters at once with my fingers. Touchscreen works in Bitwig like an MPE controller as well. I can control 2 parameters per note when playing chords and 3 parameters when playing single note with a pen. So the problem is solved for me.
I’ll buy one. Where do I sign?
I have Softube Console 1. I can’t imagine having to use a mouse going back and forth a multiple times to change parameters during sound design, production or mixing. Mastering maybe. Why not also control the pointer with it like a mouse?
A solution that would not actually require any support from the software makers, is a device that upon activation sends out mouse left button hold, and then send mouse up/mouse down, upon turning the knob, or riding the fader.
There should be a switch to make it go left/right instead for the controls that require that. And there could be modes for scroll-wheel data.
If you are willing skip the fader, it could actually be part of a special computer mouse that de-activates the typical tracking, upon activation of this feature, so any accidental movement of the mouse would not be sent. One possible design, could be putting a switch to active the mode where the scroll-wheel would be, and have a knob on the left, next to a thumb rest, and use thumb and index finger to turn the knob. (that same knob could be set to send scroll data in normal operation).
Such a device will let your hand rest on the mouse, while turning the knob. And because of the position, and the way the knob is controlled, it would be operatable, without any major issues of the mouse moving around (something that would be an issue if the design would have the knob on top, so such a solution, would most likely also need some kind of physical breaks).
You will have to move the mouse back when de-activating (after the button i de-activated the control will not move anymore but your pointer will be where you had moved it to).
This could be an alternative control-mouse, to complete another mouse or a trackball, with this special function, so it would not have to bee your mouse of choice for all applications, meaning that it doesn't have to be the perfect mouse, with a buttons with shortcuts for those that want, and it would not have to compete with a trackball when that is the preferred choice.
A more complex version could have the processing and a small flash memory that will store the movement, and upon de-activation it would release the button, and move the mouse back, by sending the reverse movement message of the mouse movement, to return it to the initial position.
But if someone would be willing to build the more complex version, they could in theory build a platform for that, that could be used for a stand alone controller, or to be built in to a midi controller.
But then one would have to move the hand back and forward to the mouse all the time, to move to the next controller.
The solution with the least amount of drawbacks, and that would be quite simple to build;
A design of a box that has two knobs, one that sends up down, one that sends left right + a button for activating the left hold message, and the processing and flash to handle the return to initial position, so when de-activating the mouse hold for parameter control, one would be able to use the knobs to move the pointer, in a simplified way, slower than a typical mouse movement, but depending on the layout of the software, perhaps not even that much slower for just getting to the next parameter. (Old mouse with balls, worked similar to that, in that they had wheels inside turning, one left/right, and one up/down, so the functionality on an electronics level would be somewhat similar to an old mouse, one could possibly even modify a scrapped ball mouse to build parts of the device, not the return value feature but, but the up/down, left/right, and mouse hold, with just some added components).
Because it has two knobs, there is no need for a up/down and left/right switch, one would grab the right knob for the type of parameter.
One could even add a third knob that sends scroll data.
This box could also have a fader. But faders, are problematic in that one would have to move it to a fitting location for the parameter one is about to control. A motorized fader would not help a lot in this case as it would not know the setting of the parameter. A motorized or sprung fader that returns to the middle position, would at least always offer some fader-movement accessible for the user. It would introduce a lot of complexity, in how the system should only listen to fader-movement data when desired, and for a spring design, one would have to deactivate the mouse hold before letting go.
Because of these issues I would leave that out.
Getting all makers to build a hover over function, or requiring the DAW makers to build this feature in, is a pretty big ask.
Building something along the lines I suggest above, could easily be achieved by a kickstarter campaign. It doesn't require a whole lot of knowledge. I know nothing about programming, and pretty much nothing about electronics, but I'm certain, that even I would be able to figure out how to build something like that. It uses standard mouse movement data, and it uses a simple design for converting knob electric signals to data, like midi controllers does, or I guess and old mouse, so the parts should be available typically, perhaps not at this very moment. For mouse design, the 3D CAD design I would need help with, and 3d Printing. But for a separate controllers, it would just be about building a box out of some material, and putting a board inside it (I think they are called breadboard or something, the ones that are used for testing or simple builds, so they aren't circuit board that require manufacturing). I'm bad at math, and don't know programming, but even the programming of a system that records mouse movement and sends a reverse message, shouldn't be that difficult, after understanding the sending of mouse movement in the first place.
If you have the energy, time, and the small amount of money (actually small amount, probably less than 100 Euros, probably less than 1000SEK incl. sales tax) that would be required to build a working prototype, you would be able to do it, I am sure.
The hover knob, I'm not sure there are any ways to achieve, since the midi 2.0 specs are basically settled on, and that would have been your best bet, and it doesn't have to do with typical midi tasks, since it involves a layer of computer operation.
Convincing the major DAW makers, could have been possible, if not all of them had a list of years old feature requests that users and potential users have asked for almost countless times.
Convincing enough software makers, would be next to impossible.
So you would only really have one other option to building something like I suggest and that is, if possible, build it in to a plugin--host. There are some plug-in hosts out there, so it might be possible to convince one of the makers, or a couple of them, rather than building your own from scratch, but if possible it might require a lot of added code to their host softwares, still, if the feature becomes widely appreciated the other makers would probably implement it as well.
But then you will be stuck in a situation where you would have to rely on a host software, and a lot of music makers tend to want to stay away from them, as they do use some resources, and one would need them on every track, so the typical command for making a new track would not work (but in many cases, templates and key commands could be used to have a way of doing it, that doesn't require manually adding a plugin host to each track).
Edit:
Building it by yourself would probably require to use of arduino, or raspberry pi plattform, which are both overly powerful for such basic tasks, building it at scale, one would be able to use better suited processing units, so a store-shelf product, could be produced much cheaper, not only by the scale, but by the choice of components in particular the processing unit. And a company like Behringer would probably be able to sell a product like that for less that 50 Euros including sales tax, perhaps even less than 40.
The Mac has a built-in setting to allow 3-finger drag (on a trackpad) that's even faster than this because there's no assignment required, and no clicking. Hover over a virtual knob and drag 3 fingers. That's it! It's wonderful.
So like Nob Control? that thing is amazing.
The main problem however is: there is no standard midi message for requesting a CC value from the synthesizer. So you still have the problem if you are activating a specific control value in the synth via the mouse, the knob (or fader) has no way of getting at the actual value. Which means: you activate the control and by turning the knob you "destroy" the current value (cause it is very unlikely that the physical position of the knob corresponds with the actual CC-value just activated). This is not a big problem if you need to completely reconfigure that control value but it is a problem if you activate a control value to make fine adjustments. Eg. fine tuning an ADSR and having to constantly reassigning the single knob to Attack/Decay/Sustain/Release would end up in a nightmare you wouldn't want to use.
(Actually a midi message: increment (decrement) value would be of great help also. But sadly there is none)
I tried this by writing a frontend to fluidsynth and noticed there is no way to do it other then the frontend GUI keeping track of all the individual values and what to do with them when the knob turns. Of course this is possible if I program my own frontend GUI, but there is no way to do it in an already existing frontend which is unchangeable to you. The knob alone will not be able to do it.
This is why keyboards usually have a number of knobs which can either be assigned on the keyboard itself to some CC-channels or can be assigner in the DAW to some functionality.
This is with MIDI 1.0. However I don't know if MIDI 2.0 will fix that issue. (First MIDI 2.0 implementations hitting the market just now in 2022)
Adding a track pad or track ball to your control box design would be a useful addition.
With Midi 2.0 wouldn’t it be possible to have a controller like the Novation XL but with additional Oled displays which state the parameter that each control is mapped to? I love using the XL but hate that i never remember what the mappings are. It seems that Midi 2.0 would allow for much more innovative midi controllers but as far as I’m aware so far no manufacturers are really jumping on board.
It's called Presonus fader port lol , the link option makes the pan pot being link to mouse controla and on what ever you point he mouse on , also my Focursite Forte interface can do that (when i'm on the go) , the fader then can also flit to this mode versus regular fader mode ....
Great video as usual ...
First of all: really nice shirt!
I like the idea and I think it would be useful in non-music software, too. Maybe the knob could be on the keyboard (the one for typing)?
Only thing against that I can think of is having to use both hands - 1 to move the mouse and the other to twiddle the knob/slider. I tend to twiddle while playing and never twiddle without auditioning the edit (as it were). I do like the idea of using the mousewheel though - never thought of doing that; will see what I have that allows it.
Woody, ps-s-st! You are reinventing the wheel. Modern VST synthesizers (at least the Roland Cloud VST) support MIDI learning, which allows you to immediately assign and re-assign any CC controllers and use them in the project as you wish. Right-click a knob in VST, select "Learn MIDI CC", then move the slider or knob on your MIDI keyboard.
How about the pointer following the hand movement which is tracked with a camera(s) which also detects the hand gesture like twist, slide etc.. ?
wow! you guys are so bright, that never occurred to me, but yeah, that's even more futuristic and awesome. surely we can do that in this day and age, we mostly have webcams.
Nice idea. I’d actually like the Hover Knob to be able to move the mouse pointer. So effectively it is a “mouse” with - bespoke knob and slider on it 👍👍
The Apple touch mouse works great with vsts knobs and sliders. You hover, don’t have to click anything, then just slide your index finger up and down. No dragging of the mouse. Been doing this for 15 years Woody. Glad you figured out how to use it 😂
sounds like a great idea, but it will only work if this feature is programmed into every soft synth. It can be done, there are controls for those type of actions. in fact there is a control output for mouse-over, mouse click-down, mouse click-up and so on. the problem is that giving the focus to anything under the mouse can cause some other actions to give errors, and those errors have to be accounted for. but still its a great idea!
This is nothing new. It's exactly how the Steinberg CC121 and Cubase have worked for years. Hover the mouse over the control, twist the knob, and the control is adjusted.
The only problem is that It’s been retired and no longer available. Plus it’s huge.
This “nOb control” controller on the other hand: czcams.com/video/_q6oYje4nAU/video.html
Why not make the knob with joystick functionality...perhaps saving going back and forward to the mouse...
others have mentioned this, but I think i'm really pitching a universal "hover-to-activate" feature that could be easily implemented by all vendors, and we already have plenty of hardware to send the midi data.
the audient id44 does that too.
@@WoodyPianoShack The trouble I doubt you'll never get everyone to implement it. Whereas a Nob control works with everything as it uses the mouse pointer. That's why it works well. Your best bet would be a piece of software that converts MIDI into mouse events.
Not sure it would work with hover as potentially going to be accidently activating midi control, in Ableton live you can click on a control & move a knob. I like the idea of having a mouse with a quality knob & slider though if that's what you mean & if hover isn't practical pushing the knob down to select the control may be an alternative.
I think its a brilliant idea,... Someone with the skills please run with this idea! I'll buy one!
I use a Logitech rollercontroller. The thumb controls the cursor and the arm does not need to move. Right click. Manipulate the graphic. Cc data is shifted. All with one hand. Also like the Nektar Panorama P1 control surface. Encoders, buttons, sliders, traction control all assignable and mine is attuned to my DAW Cubase. Color screen labels the parameters of the var you are using. Easy to customize. Popular vsts like UHe DIVA, Serum have access to already set up for all parameters. Easy to set up a vst for custom control.
Nice idea. But it requires that you use two hands. If I turn a knob I want to hear what it does, so that would take that you move your hand between the mouse and keyboard while the other hand is on the hardware knob. That can lead to a lot of moving with your mouse-hand if you want to change several parameters back and forth to get the right sound. (Let’s say filter frequency and resonance or adsr.) And then we’re back to where we started. 😊
One potential issue I imagine could come from the fader; whether the parameter being hovered over would either snap to the current fader value immediately upon hovering, or as soon as the fader was moved. A non-issue for a knob with full 360 degree rotation, of course, but the fader has only that finite physical space to work with, so it can't necessarily re-calibrate to match the current software setting for the selected value.
yeah, that needs some thought to do right. but actually, same challenge exists on any hardware synth that uses presets, where the values never correspond to the physical controls when changing patches.
@@WoodyPianoShack Fair point! I wonder if losing the fader altogether would solve the problem, instead using the knob for everything? That way, if the selected parameter was, say, at 64 when last tweaked, it would start at 64 when you go to adjust the knob up or down.
I came up with a simpler solution in my set up a while ago, that actually lets you not have to navigate to where you put the mouse at all, (which is a real time performance creativity killer) and lets you control every single knob, labeled exactly as they are in each and every synth. Think of the Arturia collection as one example of many. Touch screen monitor. It's magical. Does exactly all of that.
If you already have a monitor that isn't touchscreen, then simply purchase a USB touchscreen frame that mounts on you current monitor. They sell them to fit any size monitor. I bought one on Amazon for my 27" monitor for only $155. Worth every penny for controlling all those knobs in real time performance, just like having the real thing right there.
One last tip, mount your monitor(s) on arms which you can tilt to an angle to give you that more playing a board feel. Plus you can swing them to wherever you want when playing. I have three monitors all set up like this. I can literally have 3 different synths loaded to each monitors and all controlled by touch, completely eliminating that nasty moving the mouse business around while trying to be creative.