Armstrong took to Twitter to defend the arrangement with the Secret Service, but people still aren't happy about it.