There is an ongoing concept of goat's milking having a bad, off or goaty taste. NOT TRUE. If you believe this you have either never had it or you've had milk from the store or have had it from goats that weren't managed properly handled or the milk wasn't handled correctly.
Goat's milk taste lighter, but tastes similar to cow's milk. A link to the benefits of goat milk in Dairy Goat Journal: http://www.dairygoatjournal.com/issues/87/87-4/nutritional_benefits_of_goat_milk.html
Be thou diligent to know the state of thy flocks, and look well to thy herds. For riches are not for ever: and doth the crown endure to every generation? The hay appeareth, and the tender grass sheweth itself, and herbs of the mountains are gathered. The lambs are for thy clothing, and the goats are the price of the field. And thou shalt have goats' milk enough for thy food, for the food of thy household, and for the maintenance for thy maidens
- Proverbs 27:23-27
"I know of no pursuit in which more real and important services can be rendered to any country than by improving its agriculture, its breed of useful animals, and other branches of a husbandman's cares."