Is living with others always hell?

My family and i just moved in with our brother. I know it sounds bad, but we were not even thinking of doing it until he kept bringing it up. He is in the military and lives no where near family so we felt bad because he did sound so lonely. WE sat him down made him understand that we would have no job, barely any money, and that our kids wouldn't always be quiet like a single person would like. WE explained it all and he kept insisting that it would be fine he would take care of any finaces because he does have a good amount of money coming in until we get on our feet, but since day one of us getting here he complains about everything. I cleaned his house and did the dishes for him, but instead of a thank you i got you put that stuff in the wrong place. My husband has been out looking for jobs everyday, but everytime he gets an interview he will tell my hubby that its a crap job and he is wasting his time. He is always telling us how to parent in front of my kids, how often we should clean things so we don't waste money, that we should for the most part sit at home do nothing and listen to him bicker so we save money. We have been taking care of any personal expenses and i do understand about the eletric going up by a bit because 4 more people just moved in, but as i said before we discussed this with him. I know its difficult to live with poeple i have let others move in with me in the past but i was always polite and understood that my home was thier temporary home and they wouldn't have been living with me if they were not in a bind so i never got upset when they needed help. I was never angry when their child wanted my attention all the time because i was a new person and intresting. I just don't know what to do. We used all that we had to come out here and its going to take some time to get on our feet to move out again. He lived across the us so its not like turning back immediately is an option