Rights are whatever you can get away with. Depending on where you are, your social status, your economic status, your race, religion, etc.... your rights change drastically. In Detroit, MI you have the right to drive pretty much however you want, completely ignoring driving laws. In the surrounding suburbs, you have the right to remain silent for driving the same way. In many places, you don't have the right to remain silent; you'll be tortured to death for it. Government officials have the right to torture others and do whatever else as they see fit.
For instance, take ambassadors to the US. They are allowed to bring whatever the hell they want into the country. It is literally ILLEGAL to search an foreign ambassador coming into the country. If they want to bring a kilo of coke in their briefcase, it doesn't matter how much those dogs bark, there's nothing anyone can do. By the same token, any given Mexican carrying that same kilo across the border in their... donkey... would get life in prison for trafficking.
Taking it back to a more fundamentally philosophical level, we have the human right to do harm unto another. By the same token, they have the right to do harm to us in retaliation. It is a matter of what we can get away with and still maintain a functioning society. Even then, we have the right to ATTEMPT to throw society into chaos but others have the right to try and stop us as it suits their own needs.