That's a fairly reductive take in my opinion. Oblivion made the game approachable to a much wider audience. That may have been to the detriment of the core gameplay but it wasn't a _clear_ step backward. Some things went backwards while others moved forward.
Oblivion was a big step back from Morrowind: generic art style, map markers, no deep story.