Smith feels he's been unfairly portrayed as a thug