Radiant AI does work exactly like that. The game keeps the global cell-level pathfinding graph in memory at all times, and uses it to simulate NPC travel outside of the loaded area.
Technology wise they should be comparable, but the way its used feels different. The Gothic world felt much more alive than Oblivion, even if Gothic is from 2001 and Oblivion from 2006
