After serving as vice president of the Southern Railway System until 1917, Spencer formed the Fruit Growers Express to transport perishable goods and provide ventilated and refrigerated car services. With Fruit Growers owning its own cars and repair shops, the company earned revenue beyond its core business by leasing its assets out to other railroad companies. Under Spencer’s guidance, Fruit Growers’ sales grew from over $6 million in 1920 to almost $35 million in 1948.