@sptnkmmnt What do you mean with 'chatty English'? You have to talk people's heads off in English or?
@sptnkmmnt Think about this:
Ask them if it is a problem you're not very good at it yet, but that you're willing to learn to be good at it?
Because that would be a great way to improve your English speech skills. You'd be forced to do it and learn way faster that way.