You should always be worried about what an unchecked government will do to keep it's unchecked power. It's typically a countries own government that terrorizes its citizens to keep control over them. Constatly throwing in our face that there is a terrorist threat, there's terrorists trying to get us every day, trying to keep people afraid and dependant on the government to protect them from the boogeyman is a form of terrorism.
It's not paranoia. When they sidestep the constitution to do what they want to someone in another country, they will sidestep the constitution to do what they want in this country. And there is no one else to blame but the citizens for not causing a major uproar and upheavel in the government to say no, you do what you are only allowed to lawfully do. After all, they create laws for us to follow and expect that we better follow it or else. Well, they best start following the law set for them. And that is the US Constitution