My wife and I just got back from a two and a half week trek through the Caribbean islands. We stayed 2 nights at the Miller Manor, from December 16th to December 18th. We had an absolute blast and would recommend this place for anyone looking for a clean room and a friendly atmosphere.
The good: Miller Manor is not far from the cruise terminal, but far enoguh to where the throngs of people disembarking for the day wont disturb your stay. The Manor is also almost directly across (and above) from a ferry station. Anyone could walk from the cruise terminal (about 15 minutes to 20 minutes walk) if that's how you are arriving to St. Thomas, however we took a taxi the first time since we didn't know where we were going (took about 5 minutes to drive there). Main street and French Town are also within walking distance. The room was large, had a fridge, AC, and all the amenities one would want or need. The room was clean. We had friendly service from all the folks who lived/worked at the Manor, and their bar offers affordable snacks and drinks. The hummingbird feeders, and the dozens of hummingbirds enjoying their sweet nectar, was also a joy to watch. The view from our room was spectacular as you could see the entire harbor from the balcony (this same view is offered at their bar as well). The entire property is accessed through a locked gate that guests are given keys to so if you are concerned about people wandering in from the street, that's not happening. That said, the neighborhood was nice and I never felt unsafe walking around at night.
The bad: Nothing "bad" to report on the part of Miller Manor. I've read other reviews complaining about rooster calls, so I would like to address the roosters which, for many not accustomed to their "sweet siren call", offer a rude awakening every morning. Roosters and chickens roam freely on nearly all the Caribbean islands that I visited, including St. Thomas. Contrary to popular belief (I grew up around them as a kid), roosters don't just crow in the early morning: they crow all day long. Anyway, this is nothing that could be controlled but Miller Manor any more than could cricket chirping be controlled by Miller Manor. If you are sensitive to rooster calls, either close your door or don't visit St. Thomas, because they are literally everywhere :-P
Bottom Line: I can't recommend the Miller Manor enough to anyone wanting to stay away from the crowds but close enough to all the action. Super friendly staff, all the amenities of home, bargain drinks and food, all at a great price.
Tips: Take a taxi to the Manor your first time arriving; it's up on a hill that has easy access to everything, once you know where it is. Walk everywhere once you get your bearings.
As was told to us by staff at the Manor, the "safari taxi" (the open aired taxi that holds about 12 - 18 people) will take you all over the island, and it only costs 1 buck, 2 if you "go over the hill", which essentially means if it takes you all the way across to the other side. There are stops all over, a few just down the hill from the Manor.
Although a ferry depot is within 5 minutes walking distance from the Manor, some of the places you may wish to go via ferry would cost you a lot less by hopping onto a safari taxi and taking it to Redhook. It will take you 15 - 20 minutes to get there, you'll see beautiful parts of the island along the way, experience some thrilling roads, and it will only cost you 2 bucks. You'll save 20 - 50 dollars on the higher ferry price (depending on where you are heading) sold at Charlotte Amalie. My wife and I were heading to St. John, and it was about 40 dollars more, per ticket, to get to St. John from Charlotte Amalie than it was from Red Hook, a 2 dollar taxi ride away. If you are heading to Tortola, then the ferry depot near the Manor is ideal and your best option.
There is a "local" convenience store just down and across the steps that take you up the hill to the Manor. Don't be afraid to go inside: they don't bite. They have snacks and drinks that you may wish to stock your fridge with, and they are your closest, most affordable option.