In your opinion could it seriously happen that you get angry about him / her and that you don't like his/her .?

I have been with my boyfriend for 6 years, He drives me nuts and I hate his personality, but I do love him and wouldn't want to lose him. We have a 4 year old, we very rarely fight and do things together all the time, but no matter how much you love someone they are always going to do something or act in a way that you hate. Your never going to like 100% of things about a person.