Overcoming Decoder Inconsistencies in Whisper for Dravidian and Low-Resource Languages