How do you know 4 Brazil nuts are giving you 400 mcg of Selenium...or any selenium at all for that matter. I simply wouldn't depend on that.
It is routinely stated that our soil is depleted. Who knows for sure. But due to this possibility and unless you can have the nuts nutritional content examined I'd take a supplement. It's too important to risk!