Worked in several banks. "We are not bank, we are tech company with bank department" - was mentioned occasionally in each of them. What was also common - red tape, outdated software (tools, libraries, frameworks), restricted access to workstation, processes focused around pushing approvals around (instead of automation). That's why my response to "we are not a bank" sentiment above is "it's a bank, alright".
Saying that they are a tech company is popular amongst the big banks these days. Technically that's true - they (and most businesses these days) are driven by tech and would fall apart without it. But tech is most definitely a cost center entity at such firms and tech employees likewise treated as second class citizen. As my old engineering manager at a bank told us - "if a trader tells you to jump and dance like a monkey, you jump and dance like a monkey".
I've heard Goldman Sachs has attempted to make some strides in running their Marcus product more like a Silicon Valley tech company (within reason). But I've also heard that ultimately that it too fell prey to the burden of the old conservative bank culture. A friend who worked there until recently told me not to fall for the glitzy marketing, and that it was just all more of the same. Would be interested what someone who is actually working there now has to say, esp. someone that has worked in both SV tech companies and Goldman to compare.
Banks definitely should be tech companies, and understand and embrace the important of tech for their business. But you're absolutely right; the banks where I worked definitely tried to be technologically progressive (sometimes even a bit too much in my opinion[0]), but it was undeniable that much of the company was slow and bureaucratic, and despite all the "empowering developers", we often got stupid decisions handed down to deal with. Often they were aware of the stupidity, but changing something was still a very slow process.
At one bank, I was in a team that straddled the line between the international and domestic sections of the bank, which used to be more independent from each other, but we had to deal with both. Getting a simple firewall opened up between two systems on either side took 6 months.
[0] One bank that arguably took the tech company most seriously, wanted to be a bit too much on the cutting edge in my opinion. They were very active in the Angular community, which was absolutely great, but they also wanted to do CICD, which just didn't fit with all the security checks necessary at a bank. Parts were moving very fast, and parts were moving very slowly.
At that same bank, we also had a very clear mandate that we could say no to business. At some point, after we felt we put too much in production in rapid succession with insufficient testing, we had to block a next thing that a business guy really wanted to see in production. Really pissed him off, and he threw a tantrum I hadn't seen before or since at any workplace, but we insisted and our manager backed us up, so that was definitely good.