Just like his father, brothers, and sisters, Pieter Withoos trained himself as a draughtsman and painter. His career took off when the wealthy Agneta Block engaged him to draw her impressive collection of foreign plants, insects and birds. At Vijverhof, her estate in Loenen aan de Vecht, she cultivated the most exotic flowers and plants, including the first pineapple in Europe.