To get to the Giant’s Castle you must first plant a Giant Beanstalk plant on your garden, wait for it to fully grow, and then climb it to the top!

[Credit to BinPluss for the Video]