Unfortunately there isn't a way to do so within the app, but if you can always turn on “Do Not Disturb” or Premium users can also download content to listen to offline in Airplane mode.