Expanding a bit on the 2-dimensional sample explorer. Here is my 3d Sample Scatter Scrubber, a version that (also) uses the umap, but to 3-dimensions and plots all the samples between -1 and 1 in a jit.world. You can then use the camera and ASWD keys to navigate the space (if you want complete freedom you can disable the @locklook 1 in gl.camera). The points are highlighted based on the knearest, and with the numneighbours you can randomly play between a selection of samples in a granular style. It draws lines between recently played sounds. Hope you enjoy! And of course feedback or suggestions for improvement are welcome. This was nice to get me started again after the workshop in November.
2 Likes
I’ll check this later today or over the weekend, when less exciting things are done 
thanks for sharing!
ok I couldn’t resist - this is great!
I get a lot of warnings while I load (the kdtree is looking for neighbours before it has a dataset fitted) but once everything is loaded, the interface is gorgeous! I love the history!
I see in the analysis that you didn’t use only the means but all the stats of all of them (as discussed in another thread) but it is easy to change for me to explore (numchans 2 uses means and stddevs)
lots of fun, thanks again for sharing!
1 Like
final note: the number of slices (numslices) made is actually not -1 but +1 the number of indices. In the list of slices you get, you should add the end of the full buffer before iterating them pair-wise, so you’d get from the last detected onset to the end of the buffer.
1 Like
Super cool! I think I might link to this thread in the learn entry.
1 Like
Thanks for catching the errors. I fixed the errors in the latest commit, and also thanks for pointing out the num-slices. I joined the length of the buffer to the slices list as final point, so now the last one is included in the analysis as well.
there is also a similar patch by @balintlaczko on the thread by @rodrigo.constanzo that could be linked here, since they go even further into the deep pit of jitter 3d navigation.
Excellent - cross links are my fav
2 Likes
Ah awesome, is there some repo or place where I can have a look at your 3D works @balintlaczko & @rodrigo.constanzo ? I’m curious
1 Like
Here it is: no repo and a loooooong thread but the code is at this reply:
2 Likes
Yup, that’s it. @balintlaczko did the heavy lifting for the proper 3d navigable-side of things. Not looked at this stuff in ages, but curious to see what you come up with if it’s of use/inspiration.
2 Likes
Hey guys, inspiring work there, @tmhglnd, thanks for sharing! And as you found out we were way too unorganized to actually put the code in a repo, but hopefully the patches are still available in the forum thread.
Some months later after that thread I went down the (dark) path of implementing an audiovisual piece using a ton of jitter and flucoma in tandem, but as always, I am a “bit” behind in the documentation of it. Technically it was fundamentally the same, 3D plotting, spaceship-style 6DOF navigation, and a ton of kdtree instances creating lightning strikes, wind, rain and other phenomena on the point cloud. Honestly, I was surprised how robust the flucoma implementation of the kdtree is, and I have grown to love working with it.
Jitter on the other hand… sigh
I hope it is enough to say that I immediately switched to using Unreal Engine after I finished this piece.
3 Likes
What is the landscape like for extending Unreal? Does it have an API for making extensions/plugins?
It must do because there is an entire marketplace of hundreds of plugins/packages. Lot of them are free, lot of them are not. They can be anything from blueprints, 3D model assets, or C++, shaders, and probably a lot more that I have no idea of.
That could be an interesting parallel to explore for @tremblap later down the line as I know he is investigating (with great success) the compilation and use of FluCoMa in openframeworks right now. The game dev world is clearly meeting some need that is not supported by music-centric environments with bolt ons. https://interactml.com/ for example looks interesting for building interactive experiences supported by ML in Unity.
2 Likes
Oh this looks very nice. It would actually super powerful to have a suite of flucoma nodes available in the UE blueprint editor. But that would go beyond music and just would be a huge favor for game devs in general.