Pretty much, although I would assume they would have a found a much more efficient system of engines by then, as chemical fueled rockets are an awful method for deep space travel. NASA is currently working on ION drives, which are nothing new but becoming more fuel efficient and faster with each new design. And there is always the fun put-put engines that were designed in the 50s but would be better served for massive ships since you are literally using nuclear bombs to propel the ship (major downside, no brakes).
In the end, natural human curiosity may want us to travel the stars, the feasibility of it is just plain outside of our current level of scientific knowledge and it may remain that way for several more centuries. So an alien species that has a few hundred thousand years on us would presumably have much faster, more effective ways to travel in deep space. But that still brings us back to the initial question of: Why? Does deep space travel and exploration really HAVE a worthwhile purpose for living beings when a simple probe can do the same thing with less resources and 0 risk?