Hi Paul,
This is actually something I've been kicking for some time. I've had a lot of success modeling extant architecture with photogrammetry, and am a proponent of VisualSfM (Noah Snavely who does Bundler highly recommended it). I've also had good success getting models out of PhotoScan, which has a decent user interface for this type of thing. The benefit here is that you can get a textured model out of PhotoScan with a few clicks (and waiting), but you don't have to use additional modeling software to get generate a model.
I've seen a lot of people use Unity to re-render this for web delivery. This is a technique used by Colonial Williamsburg for their Williamsburg 1776 reconstruction of the town during the American Revolution. The down side to this technique (other than being quite resource intensive) is that it requires a plugin to actually work. I think perhaps a better way to handle this is by leveraging modern browser's capabilities with webGL.
Depending on how "good" you want the render to be, you're going to need to clean the models up in something like 3DStudio Max, Maya, Blender, or any number of other modeling tools. Just a warning, though, if you're new to this kind of software, the learning curve is steep, and the interfaces for these tools take some getting use to.
For web delivery of the models using webGL, there are two main wrappers in major use these days, three.js and kineticjs (there are others, but these seem to be getting the most traction). Using three.js, the Chaos to Perfection is an amazing interactive "stroll" around Versailles. And the project has an amazing gallery of example work. For my own work, I've had quite a bit of success with three.js rendering high-poly models quite quickly, but the main issue I've run in to is the fact that a 30Mb texture map still takes a while to download...
For geospatial delivery, I've toyed with a plugin for Omeka that would allow you to add 3D models to items (with an eye toward using them with Neatline). I've been holding off a bit as OpenLayers (the library we use for rendering maps) is going through a major upgrade that will allow you to "easily" tie cesium to the map, allow you to render terrains (and hopefully models) in 3D without a plugin.
With all that said, here are some other examples of using 3D to help visualize this kind of data:
And, if you're not prone to motion sickness, this is a visualization of 10,000+ images I did of a Spanish Monastery that steps through each image, showing a point cloud, and its shaded and textured surfaces. Calatrava.
HTH,
Wayne
