There's nothing to worry as the pup will eventually outgrow that habit. What you need to do is feed the pup with adequate food on regular schedule. Normally soiling follows after each meal, so after eating you just walk the pup around and have it do the thing in a particular area and whisk it back afterwards inside the cage.