# Fluid.noveltyslice~ loudness and pitch algorithms busted?

**URL:** <https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671>\
**Category:** Bug Reports and Issues\
**Created:** [October 8, 2022, 9:49pm UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671 "2022-10-08T21:49:13Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![rodrigo.constanzo](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/rodrigo.constanzo/32/12_2.png) [@rodrigo.constanzo](https://discourse.flucoma.org/u/rodrigo.constanzo)\
**Post date:** [October 8, 2022, 9:49pm UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/1 "2022-10-08T21:49:13Z")

</div>

Not sure if this is a bug or just a weird byproduct of how things work, but working with `fluid.noveltyslice~` at the moment, and it seems like the loudness and pitch algorithms don’t respond (across a wide range of `kernelsize` / `filtersize`) or in the case of `loudness` when it does do something, it’s orders of magnitude less than any of the other algorithms.

I’ve been testing with some of my own material, but in checking the `fluid.noveltyfeature~` helpfile (default audio example), there’s literally no response from the pitch algorithm at all (actually that’s not true, it seems to response to the change in silence when the loop repeats?), and loudness only registers the tiiiiniest blip (that’s impossible to threshold).

Is there some voodoo about novelty that I’m not understanding here or is there something odd going on under the hood with these algorithms?

---

<div class="post-metadata">

**Author:** ![weefuzzy](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/weefuzzy/32/362_2.png) [@weefuzzy](https://discourse.flucoma.org/u/weefuzzy)\
**Post date:** [October 9, 2022, 9:33am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/2 "2022-10-09T09:33:05Z")

</div>

Don’t think anything’s changed. Yes, the thresholds for different algorithms are annoyingly different. Do you have code that used to do something you wanted and that no longer does?

---

<div class="post-metadata">

**Author:** ![rodrigo.constanzo](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/rodrigo.constanzo/32/12_2.png) [@rodrigo.constanzo](https://discourse.flucoma.org/u/rodrigo.constanzo)\
**Post date:** [October 9, 2022, 10:02am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/3 "2022-10-09T10:02:32Z")

</div>

I hadn’t really used it before recently, so nothing as a comparison.

If you test the `fluid.noveltyfeature~` help file and set it to pitch, is that meant to behave that way? (literally no movement whatsoever)

---

<div class="post-metadata">

**Author:** ![tremblap](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/tremblap/32/5_2.png) [@tremblap](https://discourse.flucoma.org/u/tremblap)\
**Post date:** [October 9, 2022, 10:17am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/4 "2022-10-09T10:17:49Z")

</div>

it was always thus - hence my example code of an iterative way to ‘find’ a threshold given a number of slices. Also, don’t forget pitch is fragile to fft size so again this iterative approach was helpful to understand a (material dependant) threshold range…

---

<div class="post-metadata">

**Author:** ![rodrigo.constanzo](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/rodrigo.constanzo/32/12_2.png) [@rodrigo.constanzo](https://discourse.flucoma.org/u/rodrigo.constanzo)\
**Post date:** [October 9, 2022, 10:22am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/5 "2022-10-09T10:22:46Z")

</div>

Hmm, you would think the pitch algorithm would do _something_ with the default `@fftsettings 1024 -1 -1` for that @a.harker example. It seems to instead do literally nothing except response to the whatever changes at the loop point of the audio.

---

<div class="post-metadata">

**Author:** ![tremblap](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/tremblap/32/5_2.png) [@tremblap](https://discourse.flucoma.org/u/tremblap)\
**Post date:** [October 9, 2022, 10:34am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/6 "2022-10-09T10:34:28Z")

</div>

have you tried it in the example code I point at?

---

<div class="post-metadata">

**Author:** ![rodrigo.constanzo](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/rodrigo.constanzo/32/12_2.png) [@rodrigo.constanzo](https://discourse.flucoma.org/u/rodrigo.constanzo)\
**Post date:** [October 9, 2022, 11:05am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/7 "2022-10-09T11:05:39Z")

</div>

Where is that?

I was just going with the help files and tweaking from that.

---

<div class="post-metadata">

**Author:** ![tremblap](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/tremblap/32/5_2.png) [@tremblap](https://discourse.flucoma.org/u/tremblap)\
**Post date:** [October 9, 2022, 11:12am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/8 "2022-10-09T11:12:09Z")

</div>

oh it was in the example folder but seems to have been removed when @jamesbradbury and @tedmoore did a review… I’ll find it in the repo archive.

---

<div class="post-metadata">

**Author:** ![tremblap](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/tremblap/32/5_2.png) [@tremblap](https://discourse.flucoma.org/u/tremblap)\
**Post date:** [October 9, 2022, 11:14am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/9 "2022-10-09T11:14:33Z")

</div>

ok it is still there in a folder called ‘intelligent slicing’ in the examples folder

---

<div class="post-metadata">

**Author:** ![weefuzzy](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/weefuzzy/32/362_2.png) [@weefuzzy](https://discourse.flucoma.org/u/weefuzzy)\
**Post date:** [October 9, 2022, 11:36am UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/10 "2022-10-09T11:36:59Z")

</div>

It is moving, but so minutely I had to attach a debugger to confirm 🙄 For pitch I think the problem here is that when it was thrown into Novelty we didn’t pause to think that the two dimensions are radically different scales, so the pitch output completely swamps the confidence in the similarity calculation.

In that oboe example, the jumps in confidence are pretty important as marking the transition between those otherwise quite stable multi-phonics. When I rescale the pitch channel internally, it behaves much (much) better. I’ll push that change in due course.

There’s a constant offset to the novelty output as well, which isn’t making me happy.

---

<div class="post-metadata">

**Author:** ![rodrigo.constanzo](https://discourse.flucoma.org/user_avatar/discourse.flucoma.org/rodrigo.constanzo/32/12_2.png) [@rodrigo.constanzo](https://discourse.flucoma.org/u/rodrigo.constanzo)\
**Post date:** [October 9, 2022, 12:03pm UTC](https://discourse.flucoma.org/t/fluid-noveltyslice-loudness-and-pitch-algorithms-busted/1671/11 "2022-10-09T12:03:17Z")

</div>

> [@tremblap](#):
>
> ok it is still there in a folder called ‘intelligent slicing’ in the examples folder

Ah gotcha, the offline version. I guess that will find slices even if they are super tiny and (potentially) not representative of anything else going on. I was doing the realtime stuff.

> [@weefuzzy](#):
>
> It is moving, but so minutely I had to attach a debugger to confirm 🙄 For pitch I think the problem here is that when it was thrown into Novelty we didn’t pause to think that the two dimensions are radically different scales, so the pitch output completely swamps the confidence in the similarity calculation.
> 
> In that oboe example, the jumps in confidence are pretty important as marking the transition between those otherwise quite stable multi-phonics. When I rescale the pitch channel internally, it behaves much (much) better. I’ll push that change in due course.

That makes sense, in terms of the odd behavior. I wasn’t really getting expected results from any live input I gave it either, so is what led me to test with the examples.

> [@weefuzzy](#):
>
> There’s a constant offset to the novelty output as well, which isn’t making me happy.

Yeah, that’s quite funky too.
