This is about a girl breaking up with a boy. He says that he should've known that she would have broken up with him. Then the girl realizes that it was a mistake to break up with him, but he won't take her back. Aftertaste meaning the taste after everything. Heartbreak. He says, "I'll leave with the memory and the aftertaste." The memory of being with him.