How to Know When You Should Say No