Dolfan,
I really didn't know anything of these "Whitney's" and set about google.
It appears they had something to do with the "canal elevators" used for the Erie Canal.
The industries of BuffaloThe Buffalo that we recognize today is nothing close to what it was before prior to the opening of the St Lawrence Seaway.
Also some another reference (also late 1800s) where some Harvard/Yale Baseball games were held on the Whitney Estate in Saratoga. That reference mentions "the driving park".