But travelers insist that you shouldn't just pass through Central Park – often referred to as New York City's backyard ... You'll find the main gates at Fifth Avenue and 105th Street.