# 3D Audio Corpus Explorer - Alpha Demo
**URL:** https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212
**Category:** Code Sharing
**Created:** [February 23, 2024, 5:21pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212 "2024-02-23T17:21:39Z")
**Posts on this page:** 15
**Page:** 1
### Author:  [@fearne](https://discourse.flucoma.org/u/fearne)
#### Post date: [February 23, 2024, 5:21pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/1 "2024-02-23T17:21:39Z")
Hi folks! I’m a postgrad at Huddersfield and have been working on a 3D tool for the purpose of corpus browsing, wanted to share a very early first prototype for y’all to play around with 🙂
Inspired by similar tools like [AudioStellar](https://www.audiostellar.xyz/lang/en/index.html), but with a 3D twist, in a vein similar to [this](https://discourse.flucoma.org/t/3d-sample-scrubber-with-jitter/1199) and [this](https://discourse.flucoma.org/t/fluid-datasetplot-abstraction-for-2d-3d-visualization/783/82) from @tmhglnd and @balintlaczko. Though I’m also quite interested in displaying multiple points per sample, showing how one audio sample changes over time in the extra Z axis.
I’d say at the current stage it’s an early alpha, so _expect some bugs_, but it’s got enough to play around with now that it should be fairly interesting to try out!
If you do give it a try, I’d really appreciate it if you took just a bit of time to fill in the feedback form, it’d really help me with my research!
[\>\>\> Feedback Form \<\<\<](https://forms.office.com/e/mgPWvZBKdS)
[ACorEx - Windows](https://discourse.flucoma.org/uploads/short-url/qQYLmprqnGnR4bcovVLcJABVSXh.zip) (5.9 MB)
[ACorEx - MacOS](https://discourse.flucoma.org/uploads/short-url/5kIE93upDrhmJJ2TKq3K7KjwEpE.zip) (6.5 MB)
Linux to also come down the line.
[Test Samples](https://drive.google.com/file/d/1XuIhvNxEhHogRF0541o8Kq5PVigpKiYK/view?usp=sharing) (266 MB)
(or use your own sample collections! \*currently only works with mp3/ogg/wav/flac file formats)
---
### Author:  [@rodrigo.constanzo](https://discourse.flucoma.org/u/rodrigo.constanzo)
#### Post date: [February 23, 2024, 5:47pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/2 "2024-02-23T17:47:44Z")
Very cool.
I spend so much time looking at UMAP’d plots that it’s odd seeing the same corpora in a different / more object space:
Look at that one silly little line lol!
---
### Author:  [@jamesbradbury](https://discourse.flucoma.org/u/jamesbradbury)
#### Post date: [February 24, 2024, 5:16pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/3 "2024-02-24T17:16:25Z")
I like the basis here. Very lightweight, easy to share, easy to use too!
Some food for thought:
1. I think resampling the audio to a lower sample-rate will give you a huge speedup for batch processing and in my anecdotal experience the results are still pretty good for pulling apart samples spectrally.
2. WASD support? 🙂
3. Envisage a way early on to have the data you create in the application exportable, so you can use it everywhere else for yourself, but also make it possible for others to integrate it as a tool in a flexible way.
Cool!
---
### Author:  [@moonpalace](https://discourse.flucoma.org/u/moonpalace)
#### Post date: [March 19, 2024, 8:14am UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/4 "2024-03-19T08:14:40Z")
Hey @fearne ,
just tried ACorEx and it’s great, very intuitive. Yeah, WASD would be awesome to have 😉
I saw that in the folder there are two fmod dll, what are those for? I’m curious because I use FMOD everyday and I’ve been dreaming to have a plugin like this one for ages.
---
### Author:  [@fearne](https://discourse.flucoma.org/u/fearne)
#### Post date: [March 19, 2024, 3:22pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/5 "2024-03-19T15:22:44Z")
Thanks @moonpalace! I’m primarily using OpenFrameworks for the cross-platform implementation, I believe FMOD is just one of the libraries they use for high level sound playback 🙂
---
### Author:  [@Electrumpet](https://discourse.flucoma.org/u/Electrumpet)
#### Post date: [April 6, 2024, 12:47am UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/6 "2024-04-06T00:47:13Z")
Thanks. This is very nice for the extra information that is captured in the spatial figure of the complete sample. Also interesting from a visualisation perspective. Also the navigation in 3D space using a trackpad is much more intuitive and responsive than what I am used to when using 3D programs like Rhino or Unity.
That said, it is also difficult to recognise individual samples within the corpus. Do you intend to use some sort of color scheme perhaps to show which points are actually connected to each other before selection?
It would be nice to have some sort of separate scaling on the time axis.
I have just started exploring the idea of literally using 3D space for controlling using Mixed Reality glasses (Xreal). The engine used for 3D mapping is unity. In my specific use case I’ll probably go with that environment for further development for the moment. Something to take into consideration perhaps?
---
### Author:  [@Electrumpet](https://discourse.flucoma.org/u/Electrumpet)
#### Post date: [April 6, 2024, 1:05am UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/7 "2024-04-06T01:05:10Z")
I tried to do your questionnaire. I came to the end and was only then confronted with the many microsoft accounts I have apparently accumulated to conform my responses. Through various interactions with said company I have accumulated those and none of them worked. You might have a failed survey. Screw microsoft. I am not going to try endlessly. Sorry.
---
### Author:  [@fearne](https://discourse.flucoma.org/u/fearne)
#### Post date: [April 6, 2024, 1:26am UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/8 "2024-04-06T01:26:58Z")
No worries Hans, it came through, thanks 🙂
Colour is on my list of areas to tackle for better visual clarity for sure.
Virtual/mixed reality has crossed my mind, it’d definitely be interesting to explore! Though I think it’s a little outside the scope of the project for me at this moment.
---
### Author:  [@Electrumpet](https://discourse.flucoma.org/u/Electrumpet)
#### Post date: [April 6, 2024, 2:09am UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/9 "2024-04-06T02:09:24Z")
Yeah, I understand that MR/VR is a step further when applied within your project, but it is probably an idea to think about the exportability / integrability of your project in these environments.
---
### Author:  [@fearne](https://discourse.flucoma.org/u/fearne)
#### Post date: [June 3, 2024, 6:25pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/10 "2024-06-03T18:25:55Z")
To update this thread, I’ve just released version 0.2 of ACorEx, and you can download it from [https://fearn-e.github.io/acorex](https://fearn-e.github.io/acorex).
There’s been a lot of new features and improvements, to name a few:
- Switching between 3D and 2D views
- Many more analysis options + UMAP reduction
- Better camera navigation
- Swapping out analysed descriptors in real time
- Performance improvements in analysis and the explore point picker
I’m looking forward to anyone who’s interested trying it out and providing much appreciated [feedback](https://forms.office.com/e/2RWL8WSvmf) 🙂
---
### Author:  [@sleestack808](https://discourse.flucoma.org/u/sleestack808)
#### Post date: [August 30, 2024, 8:28am UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/12 "2024-08-30T08:28:47Z")
Hi, Doesn’t seem to work on my Mac M2. Ive tried loading different folders. Hit confirm, wait. Load the corpa and nothing. No dots no sounds. The first version worked though
---
### Author:  [@fearne](https://discourse.flucoma.org/u/fearne)
#### Post date: [September 2, 2024, 4:54pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/13 "2024-09-02T16:54:09Z")
I’ve replied to this on your github issue 🙂
---
### Author:  [@tremblap](https://discourse.flucoma.org/u/tremblap)
#### Post date: [September 2, 2024, 5:37pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/14 "2024-09-02T17:37:36Z")
and the said gh issue is here 🙂
>
>
> I can't seem to get any sounds loaded, I used the first version and was successf…ul. Ive tried loading a few different folders of sounds. I load the corpa and nothing. Just lines no dots, no sound
---
### Author:  [@fearne](https://discourse.flucoma.org/u/fearne)
#### Post date: [September 2, 2024, 6:23pm UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/15 "2024-09-02T18:23:19Z")
To add, v1.0 is now out and it has a new tool to make acorex more useful for music making. When playing files, there’s now the potential for the playhead to “jump” to nearby points out of order, crossfading to different points in the same audio file or even other files that have similar analysis values.
Can be found on the same website as the previous version.
[https://fearn-e.github.io/acorex/](https://fearn-e.github.io/acorex/)
Any feedback and thoughts on this would be greatly appreciated as always!
[https://forms.office.com/e/fW2d5GPPT4](https://forms.office.com/e/fW2d5GPPT4)
---
### Author:  [@sleestack808](https://discourse.flucoma.org/u/sleestack808)
#### Post date: [September 3, 2024, 1:11am UTC](https://discourse.flucoma.org/t/3d-audio-corpus-explorer-alpha-demo/2212/16 "2024-09-03T01:11:12Z")
Sorry, I lost track of where the app was… My bad