Hey, I live with an off grid system, biggest downfall besides the price is that in the winter the panels get covered with snow and mine are three stories high. I have a JLG crawler but its such a hassle to wake up boot up the machine, clean them, then wait for the batteries to charge. I would recommend keeping your panels accessible if you're in an area with hard winters.
Also the biggest upside is you can build anywhere, I built a huge log cabin that was getting denied by the city, so we just didn't tell anybody and built it anyway off-grid.