Search via Audio Analysis based on Similarity
Hi everyone, long-time Basehead user, and would like to request a major feature.
Here's a typical, daily scenario I think many of us struggle with...
- Spot a video and figure out I need some specific source element, for example metal ping with a particular timbre.
- Search basehead for 'metal ping', get 5000+ results.
- Click the first one and start pressing the down arrow to listen to the results one at a time.
- A few mins later I find one that's close to what I want, but still not quite right.
- Realize I'm only at sound 271 out of 5000+ and it will take me quite a long time to finish auditioning them all.
This scenario is super, super common. It probably encompasses a majority of the time I spend doing sound design, hunting through my vast library that isn't always consistently tagged by the recordists and contains over 230,000 records, looking for a particular type of element for a sound I'm creating. The other day I realized that I have some much older libraries that contain thousands of useful footstep foley sounds, but none of them are tagged with metadata in a useful way and never show up in my searches (not even the filenames make sense). I simply stumbled onto them by accident and realized they would have been really great for a few previous projects. The longer a person works in this field the larger their personal library collections become, and the problem just keeps getting more time consuming to work around.
I think an amazing solution to this problem would be having Basehead analyze the waveform content and allow us to search for sounds with similar waveform content. For example if I find a sound that close to what I'm looking for, but still not quite right, I can choose to search for other sounds in my library with similar harmonic or timbre properties regardless of file name or metatags. There's a program called Sononym that does this fairly well but it's aimed at music producers and not sound designers. I think having an ability like this inside Basehead that's geared towards a sound designers workflow and search needs would be absolutely incredible, and directly translate into massive amounts of saved time on every single project I work on.
Anyone else like to see this? Thoughts?
Yes this is a MAJOR MAJOR feature!
Got a spare $10,000 lying around to make it? hehe
Cuz that is what it will cost to do this feature right and the way I want to do it!
BUTTT...actually we already do have something like this in development started back in January and then the Pandemic hit and we had to put it on pause cuz it will take a ton of money to complete and no one is spending now to give us the seed money needed to complete it.
Hopefully next month we can continue on this and put it back on track so it drops before the end of the year. 8)
I think this will be THE MAJOR feature that can make the difference between one audio search software and another...Sure Sound Designers we want this feature as soon as possible. In terms of business...software developer must decide how much money they want to spend depending on how advanced (and how much it costs) AI is. AI is really making giant steps but maybe for a audio search engine can be so much expensive in relation with the $ incoming...
But sure: the first developer getting this done will beat all the others up!
I'm sure that doing this from zero could be really close to suicide. Maybe you need a collaboration with other companies with experience with deep learning audio AI.
Good luck and really interested in seeing what this will be.
¿How can I vote a request?