Take a piece of cardboard and measure off the distance from your bed to the bedroom door or farthest window. Now, go to the range, set the cardboard at that distance and squeeze off a round of #6 or #8 shot. I seriously doubt the pattern will be larger than four to six inches. Do the same for the largest room in your house.
Also, make a mental map of where things are in your shooting lanes, ie...kids bedrooms, bathroom, other areas that you DO NOT want to shoot towards. Know these places from every room in the home.
Unless you have an absolutely enormous home, you'll be fine but do some testing. Shotgun shells are cheap.
I don't own an AR and probably never will. There are plenty of other options available.