Yes, it's delicate balance between quantity (of episodes listened to) and quality (of understanding)…
I wish I could understand content well at 2× or 3× the speed, as some people apparently do (!), but I miss too much above 1.5×.
(Come to think about it, it's a matter of language too: I think I absorb 2× Spanish well, actually. But English being a foreign language to me adds a bit of extra difficulty and I need more attention.)