Looking up every word is a waste of time. If you familiarise yourself with common prefixes and suffixes, you'll be able to understand the meaning of many words without needing to look them up in the dictionary.
Most people recommend looking up words that you can't figure out at all.