Baby goat milk question

We just received a 4-5 week old baby Nigerian Dwarf goat last night. He ate all the rest of the milk we were given this morning. We've seen online that at this age he can have whole cow's milk from the grocery store, but we also have a can of puppy replacement milk. Would it be safe for him to have that milk replacement (or whole cows milk) till we can get baby goat milk replacer?