I had / still have a little food intolerances , too. What helped / helps me is skipping the food I am intolerant to for a couple of weeks and then try again. Just eat what you can and the body will eventually come back to normal. So don´t worry.
I´ve just been reading an article that someone here postet about Candida that has a paragraph about the connection of Candida and food intolerance: