Dummy / Pacifier and colic in a baby help?

My baby has bad colic from 8pm to 2am every evening. We are trying Infacol and Colief (not much help so far). He is 3 weeks old and we are wondering about trying a pacifier / dummy. Can you give one to a baby for just that period of time in a day without them getting dependent on it? He is good at settling himself at other times in the day and we want to try and maintain that with out the need for a dummy. I have no experience in this and swore I would never use one but we will try anything now!