You've planted a Horse Chestnut in a little garden next to a fence. When not restricted in a little pot they grow more than 18" a year. They grow to 60 feet with a spread of 50ft.
Did you look into the species before planting it, some brief info in this link?
https://www.treehelp.com/horsechestnut/