Custard Milk Ice Cream Recipe | How to Make Custard Ice Cream at Home. Though the ice cream was made without using cream and condensed milk, it is creamy and its taste is awesome. For this custard popsicle ice cream, you can skip food color. As cooking time of this custard popsicle recipe is short you could make this recipe within few minutes. Hope you enjoy!