The Stampede Inn is pretty much the only place to stay in Elgin. The rooms are comfortable and clean although basic and a little tired, with a refrigerator and coffee maker. There's a vending machine outside for drinks and the like. The Wifi isn't great, but it does work. Reception is friendly and helpful.
You may get to see deer grazing in the neighbouring gardens in the evening and watch out for them on the streets in Elgin!