This is a conversation expression that is meant as a light-hearted way of telling someone who is performing an action (e.g. singing, drawing, telling a joke) that you do not think they are very good at it. In other words, they wouldn’t be able to earn money doing that action.
Tom: What do you think of my painting? Mary: Um..well, I wouldn’t give up your day job.