Discover your dream Career
For Recruiters

Banks only pretend to embrace Agile development

It's still the waterfall method.

These days, with the onslaught of fintech, challenger retail banks and ever reducing margins, bulge bracket banks are all about "digital transformation” to unlock productivity and become more profitable. Marcus by Goldman Sachs is classic example. - Banks want to leverage the power of data, redefine their operating models and become digital driven organisations. Managementese nonsense aside, all banks have been trying to get their technology organisations to use agile software development practices in an effort to compete with the rate at which fintech rivals can release new products. 

Agile software development comes from the Agile Manifesto published in 2001. This set of principles was combined with a practice of iterative development called scrum. The idea was to release software to users every two weeks or so, with feedback from users going into the next development cycle. There are daily stand-up meetings to micromanage track progress on an agreed set of tasks for the cycle. There are many different tools and techniques that fall under the term agile. It has become a synonym for iterative development in general.

Many claims are made about how certain tools, technologies and practices improve software development. Indeed, a whole cottage industry of “certified" consultants and coaches around Agile engineering practices is now well established. I’ve seen them dotted around the banks I’ve worked for, trying in vain to effect some cultural change.

Now, it may come as a surprise but as an industry we actually know very little, empirically, about the effectiveness of software engineering practices. One of the reasons for this is that it’s incredibly hard to collect data given the proprietary nature of most large programming projects. Of the studies that have been done, we know for example that code reviews reduce bugs in production, and pair programming improves code quality with a trade off in productivity. The famous "10x programmer” who is supposedly 10 times more productive than the average developer? Well, it would help if we could come up with an objective way of measuring developer productivity for a start. And we can’t. Frankly, in my opinion, we are in the midst of a software engineering methodology racket. It’s all anecdotes and common sense, with little attention on studying outcomes or collecting evidence and banks like everyone else have been taken in by it.

The fact is that many technology teams in banks still do waterfall development even if lip service is paid to Agile. -  They may have incorporated some of the agile ceremonies, tooling and principles into their day to day work, but their product will only be used when it’s finished. Traders, salespeople and bankers have neither the interest nor the human resource on their teams to devote to product managing technology projects. Because of this, engagement with technology is contracted out to their business management teams.

This is the big problem with software development jobs in banks. Iterative software development of the agile scrum variety requires constant feedback and domain experts readily available. That doesn’t happen most of the time in finance. What does happen is a team will deliver a finished product and it’s not quite right - at that point there will be a rush with good business engagement on ironing out the bugs and shaping it into something usable. I’m not saying that there aren’t teams out there with very good business engagement practicing true scrum agile, I’m just saying that it isn’t the norm in large banks.

So, what should banks be focussing on in order to automate more aggressively? In my anecdotal experience, the stars need to align on a few fronts:

  • Co-located teams of developers with a healthy mix of juniors and seniors and a strong tech lead. You just need good people who like working together and care first and foremost (this is hard).
  • Rather than specifying the way to work (agile or otherwise), allow teams to self-organise, survey the politics of the wider organisation and agree an operating model with the business they support.
  • First class tooling so that it is easy to integrate, test and release newly developed software.
  • Cloud infrastructure with minimal bureaucracy so teams can manage and scale their hardware plant.

Highly engaged partners and domain experts in the business who are incentivised to give their time to technology projects (this is really hard.)

Have a confidential story, tip, or comment you’d like to share? Contact: in the first instance. Whatsapp/Signal/Telegram also available.

Bear with us if you leave a comment at the bottom of this article: all our comments are moderated by human beings. Sometimes these humans might be asleep, or away from their desks, so it may take a while for your comment to appear. Eventually it will – unless it’s offensive or libelous (in which case it won’t.)

Photo by Patrick Perkins on Unsplash

AUTHORDaniel Jones Insider Comment
  • An
    Animesh Yadav
    23 October 2019

    Yes, I really appreciate your post about agile development in banks. I know Agile works most effectively in a small and fast growing company trying to keep up with high demand. For making the company best level we should contact with the proper scrum provider & I think “tryScrum” has a better solution for this.

  • Fa
    22 July 2019

    I prefer a hybrid of the two. Ideally a shorter release cycle, structrued documentation and thorough testing phases. A structrued approach such as Waterfall is extremenly important in large organsations where control processes are audited. Yes it may be slower but you need time to consider all the impacts your development has on the business and the function.
    Agile works most effectively in a small and fast growing company trying to keep up with high demand. Thats it. Thats its purpose, nothing more. Once companies grow larger the rate of change slows and development then becomes more strategic. Both have their place but at different stages of the growth cycle.

  • Gu
    Guru Kalle
    15 July 2019

    I think Traditional Water Fall Methodology still makes sense. I have seen big financial services company such as Healthcare, Banks using traditional water fall methodology to do a good development, testing multiple times (SIT, UAT/Integration), then migrate to Production. This model works rather than Agile model where requirements keep on changing, not well tested, finally wait in UAT Stage till the complete integration testing is complete.This amounts to same thing as Waterfall Methodology. Type of development must be decided by experienced Sr. Managers, Business Analysts who have years of experience in the field rather than developers who would want to define development life cycle. Water fall Methodology also leads to stable release management, product development as well as stable careers for the stakeholders

  • He
    Henry Majander
    15 July 2019

    Ah, but you forgot even if the software development was true agile, the change process definitely is not. To deploy anything, to do a database change, you need a lead time, usually a committee approval with full impact analysis, and thorough documentation. Nevermind the paranoid security audits in finance. Being attached to an agile team or several to waste 1/2 my day just to say ”there is no conformity of purpose before the mutual satisfaction of requirements”... I’ve had DBA teams just toss the change tickets as the database was already changed last week, ”decide what you want to do first”... And then I am the bottleneck why there is no progress... I’m a damned fakir navigating this, but I get hives just from hearing the management say agile. Any management must ask themselves this: Is our change process agile? If not, then stop being silly. Agile software development in a strict waterfall change process environment is like teaching a pig to sing, it wastes your time and annoys the pig.

Sign up to Morning Coffee!

Coffee mug

The essential daily roundup of news and analysis read by everyone from senior bankers and traders to new recruits.

Boost your career

Find thousands of job opportunities by signing up to eFinancialCareers today.
Recommended Articles
Recommended Jobs
Macquarie Group
Securities Financing/Collateral Trader - Manager
Macquarie Group
London, United Kingdom
Meredith Brown Associates
Product Development Consultant
Meredith Brown Associates
London, United Kingdom
Kite Human Capital
Credit Market/ Fixed Income Sales - Electronic Trading
Kite Human Capital
London, United Kingdom

Sign up to Morning Coffee!

Coffee mug

The essential daily roundup of news and analysis read by everyone from senior bankers and traders to new recruits.