Rex Baker was born and raised in Rochester, New York, where sports dominated much of his early life and teenage years. He enjoyed lifting weights in high school and was heavily involved in sports and athletic activities, from lacrosse to football, and continued lifting weights throughout his college years, though he did make time to play lead guitar in a rock band. After graduating from the University of Rochester, his weight-lifting turned into two decades long, successful career in competitive bodybuilding.