Yes, one very potent herb, turmeric will help. You take 2 teaspoons of turmeric powder in water two times a day, one at night has to be before bedtime, and do not drink or eat after that. It tastes bitter, but very effective.
Second thing is warm water and Sea Salt gargles, I had this condition many years ago and my doctor suggested to do salt gargles. It helped.
Ask a question on Iodine supplementation forum, if you can take Iodine for it too.
But Turmeric should clear it up. Good thing you do not want to remove your tonsils, they are your immune system's gate keepers.