How much Japanese should I know before going to Japan?

Japan has its official language: Nihongo, or simply Japanese. Suppose you’re planning on visiting Japan. This, perhaps, raises the question, do you need to know a bit of the language to survive a trip to Japan?