I think, usually the criterion is mutual understandability, but there are exceptions like chinese, where some linguists argue, the dialects should be considered different languages, because people from different provinces can't understand each other, but they are still considered dialects because of the political implications.