Turns out it's the subtitles. As I watch a lot of anime it's either good subtitles and transcode, or bad subtitles and direct. As the extra styling is not covered by the application

It's true I could change it to external player but then you lose half the features...

[–] [email protected] 2 points 1 year ago

For instances like this, you could either use the Jellyfin plugin that extracts embedded subtitles, such that they are stored in an .art file and don't need transcoding, or set up Bazarr for the same (amomg handing all your subtitle needs).

I found that I preferred Bazarr, especially with notifications through Gotify, as I would directly see what took place when a subtitle was pulled, where as the Jellyfin plugin felt a bit like a black box.