The Seine isn't particularly beautiful (polluted and brown are better adjectives). But it's surrounded by beautiful urban scenery.
I'd recommend a river boat tour early in your stay in Paris. It will take you by some of the main attractions of the city, and give you a sense of scale and orientation for future explorations. We took a tour on...
More