My boyfriend keeps blowing me off

My boyfriend has been “sick” that past few days, and although he has not been too well, he has been using it as an excuse. He texts me very little during the day, and plays video games all day. We call at night and go to sleep together, but he has told me he will not be calling me because he wants to hangout with his brother. When he says this, he is really playing video games with him, his brother does not live with him and they game all day. I am quite annoyed and I am sure he will try to call me later when he is bored or cannot sleep. Would it be wrong of me to ignore him or refuse to call?