Selection box doesn't rotate when an object rotate!

I think it is a weird behavior. I made a game in which i want an object to be removed when i click on it (and timing is important in my game.) When i click on a rotated object( for example 45 degrees) , only clicking on parts of it that matches with selection box is effective and object will remove. But clicking on parts of object that is out of selection box(because of ratotaion) does not cause object removing.