Rep. Madison Cawthorn, the youngest member of Congress, failed to hold onto his House seat, after critics said the 26-year-old brought too much negative attention to his North Carolina district.