I tested it with a test light. Should I use my voltmeter or go get a relay. Am I wrong to say it's the fuel pump since I had power there

 

You can not get any sort of an accurate test with a failed or in your case the wrong relay in place of the fuel pump slot.
Go get a relay.

 

it was the fuel pump and the other relays with same numbers on top will run the pump.

 

I am aware of the different relays and their numbers, but unless yours is for some reason different their is only 1 #4 relay, that is why I thought you might have installed the wrong one.
Glad you found the problem, did you replace just the motor or the entire pump housing assembly?

 

I have for yellow relays under the hood the first 1 is different then the last 3 these have the same numbers on top. I got a used pump and assembly. I just started a new thread about this pump. if you want to chime in!

Thanks Joe

 

I went and rechecked my truck to make sure on the relay. There are, depending on your options, 4 yellow relays in your holder, only 1 is stamped with a R6l2 numbers, which is the for the fuel pump, the reset are Rl63 or Rl64 relays, so if you swapped relays, you have the wrong one in the fuel pump socket, the others won't work.