Don't forget my little proviso of "done right"
I think you understood my concern when you say "happens naturally". Even if some didn't happen naturally, it has to feel that way when you read it. And, like everything else in the story, there should be a point to them. Either they help to fill out the character, to change or enhance the atmosphere ... or whatever.
I'm re-reading my Agatha Christie collection at the moment, and one of her tricks was to bury the critical clue in the little details and problems being discussed early in the book. So in her case many of the little problems were camouflage. In other books I've seen little problems used to add humour and lighten otherwise slow/difficult places in the story. Use them to your advantage rather than just add them for colour.