Guinea Pig Vitamin Deficiency – Your Guinea pig looking down and out? It is probably because of a lack of Vitamin C. Their bodies can’t make it. Add a bit to their water and they should be fine.