This is an Article I power, no amendments needed. Congress passed the law, the President has to follow that law, not just decree it doesn't apply because people are being mean to him. By framing it as an issue of human rights, you're missing the part where it's a violation of our fundamental principles of governance.
"Kitto daijoubu da yo." - Sakura Kinomoto