Subscribe on LinkedIn
Embrace the gift of boredom this Christmas
David Knott David Knott

Embrace the gift of boredom this Christmas

It’s Boxing Day today, which means that, if you live in the United Kingdom, you are entering the limbo period between Christmas Day and New Year’s Eve. (Other countries may have the same experience, but I have only ever celebrated Christmas in the UK, with our holiday timing and traditions.) The presents have been opened, and the Christmas dinner has been eaten. Batteries have been found for the toys that needed them, but they’re starting to run down. The board games have been played, and you are wondering when your relatives are going home. It’s dark outside and it’s possibly raining. Most of the shops are shut. In theory, tomorrow is a working day, but lots of people are still on holiday.

You might feel a bit aimless during this period. Possibly even a little . . . bored?

At this point, you may be tempted to reach for one of the distraction devices that most of us have to hand (you may even be reading this article on one of them). Perhaps what’s needed to brighten up these midwinter days is to scroll through a social media feed, to reply to all of the messages in the chat group, to scan the news, or have a quick go on a mobile game.

Or perhaps not.

Read More
All I want for Christmas is speed and reliability
David Knott David Knott

All I want for Christmas is speed and reliability

What were your Christmas lists like as a child? Were they modest requests for improving books and educational toys? Or were they, like most Christmas lists, an extravaganza of wishes, containing toys and sweets and games . . . and possibly a dragon and a unicorn?

It sometimes feels like our requirements for software development are like a Christmas list written by a very small child that wants everything at once. We’d like the ERP package to have world class embedded processes, but we’d also like it to customise it to meet our every need. We’d like the cloud platform to give us capacity on demand and pay as we go, but we’d also like it to be on-premise because we’re worried about security. We’d like an AI system that predicts our customer’s needs, but we’d like to do it without using our data.

And being a project manager or a product owner can feel like a harried parent who can’t possibly afford everything on the list, and is worried that Christmas morning is going to be a disappointment. If I give them all the customisations they want, then we can never take the upgrade. I can give them security on cloud, but they’ve got to understand the shared responsibility model. I can build them an AI model, but not unless someone’s prepared to share the data.

Read More
Precision is not pedantry; clarity is not cynicism
David Knott David Knott

Precision is not pedantry; clarity is not cynicism

The Nomenclature Committee of the Association of Computing Machinery might not sound very exciting. However, it got to decide the words that we use to describe computers, and words matter: naming is a powerful act. When the computing pioneer, Grace Hopper, chaired the committee in the 1950s, she steered them to avoid ‘words of the magic brain class’, and to use terms such as ‘storage’ instead of ‘memory’, and ‘processing’ instead of ‘thinking’.

This direction was needed in the 1950s. Computers were new, and to most people they seemed like magic. Even though the computation they performed was complex - since the early days, computers had been used for hard mathematical problems such as code breaking and navigation - they did far less than the computers we have today. Today, it would seem strange to describe a machine that was limited to mathematical operations (no speech, no graphics, no sound) as thinking. Yet, in those early days, it was astonishing that computers could compute at all: that they could do work previously reserved for the human brain and mind. It is unsurprising that they were described with breathless excitement.

Read More
Playing the triangle: breaking down technology risk
David Knott David Knott

Playing the triangle: breaking down technology risk

What’s more risky? Building a hotel on the side of a volcano, or trying to deliver a software project?

Years ago, while working for a bank, I heard a talk from a colleague in the Structured Finance team: this team created complicated lending structures for projects that carried high degrees of risk. He told a story about a loan for a hospitality business that was building a new resort on the side of a volcano. Unsurprisingly, that project required some complicated risk models.

I put up my hand and asked, ‘How do you model risk for IT projects?’

The banker smiled and shook his head.

‘We don’t,’ he said. ‘Far too risky. They fail all the time and we don’t know why.’

Read More
An infinity of interesting problems
David Knott David Knott

An infinity of interesting problems

In 1944, Grace Hopper was working on the Mark 1 Harvard computer, solving mathematical problems for the US military. The machine had a clock speed of three hertz - three cycles per second. That’s not three million, three thousand, or even three hundred - it’s three. By contrast, today’s processor speeds are measured in gigahertz, billions of cycles per second. In order to get more power out of the machine, Hopper and her colleagues figured out ways to inject more instructions into the machine in what would otherwise have been idle cycles: an early form of parallel processing.

Across the Atlantic, in Bletchley Park, Tommy Flowers faced a similar problem, but adopted a different solution. The Heath Robinson machines intended to break even more complex codes than Enigma, lived up to their name - they were complicated and prone to failure. He proposed to replace the electromechanical relays with vacuum tubes, creating the first ever electronic computer. His colleagues were sceptical, until Flowers and his colleagues proved that a computer could be built from electronic parts, and could run thousands of times faster than the alternative.

In the 1960s, Margaret Hamilton and her team in MIT were writing the software for the Apollo Guidance Computer, the machine that the Moon mission would depend on. The size and weight of the machine were severely constrained, to the extent that the computer architecture only had three binary digits available to encode each command. If you know your binary, you’ll realise that three binary digits only have room for eight numbers - and eight commands are not enough to get a spacecraft to the Moon and back. Hamilton’s team came up with ingenious ways to extend the AGC’s core vocabulary to just under fifty commands - and then built an interpreter to extend the vocabulary even further and code in a language that was easier to understand.

Read More
Embrace the low-coders and the no-coders (and perhaps even the GPTers)
David Knott David Knott

Embrace the low-coders and the no-coders (and perhaps even the GPTers)

In the early 1950s, there was a problem with programming. Digital computers offered the promise of automation and innovation: the press was full of reports about the wonders of ‘electronic brains’. But it had become apparent that just having computers was not enough: to do useful work, they had to be programmed, and programming turned out to be hard.

It’s important to remember what programming meant in those early days. It did not mean opening up an IDE: there were no IDEs, there were no text editors, there weren’t even any screens. It did not mean importing libraries, or entering commands in a language which looked like English. It meant breaking down every problem into mathematics, and then breaking the maths down into basic arithmetic and atomic logic. The primary productivity innovation was the creation of assembly languages: symbols and mnemonics to make it easier to shuttle numbers in and out of memory and perform operations on them - but even these languages were only one step away from the physical hardware.

Read More
Practice takes practice: don’t mistake AI proliferation for maturity
David Knott David Knott

Practice takes practice: don’t mistake AI proliferation for maturity

“This is only a foretaste of what is to come and only the shadow of what is going to be.”

These words appear on the fifty pound note issued by the Bank of England, under the portrait of their speaker, Alan Turing. They come from an interview with Turing in The Times in 1949, and continue, “We have to have some experience with the machine before we really know its capabilities. It may take years before we settle down to the new possibilities, but I do not see why it should not enter any one of the fields normally covered by the human intellect, and eventually compete on equal terms.”

The current wave of innovation in AI has led to more excitement about the last part of this quote than the rest, “I do not see why it should not enter any one of the fields normally covered by the human intellect, and eventually compete on equal terms.” Much of the press and social media, along with masses of marketing material, would have us believe that AI models are already competing on equal terms with humans, even if every article about how an AI model has passed the bar exam, or leapt some other professional hurdle, seems to be offset by another article questioning the legitimacy of the test, and yet another giving examples of how the model got things wrong in hilarious ways.

Read More
Don’t talk to me about legacy: I’ve got wax in my ears
David Knott David Knott

Don’t talk to me about legacy: I’ve got wax in my ears

I learnt a new concept this week, from Cory Doctorow's blog: the idea of the Ulysses Pact. It comes from the part of the Odyssey where the Greek hero orders his men to tie him to the mast of his ship as they approach the lair of the Sirens, monsters whose songs lure sailors onto the rocks. Ulysses’ crew will follow the standard remedy of blocking their ears with wax, while Ulysses will become the first person to hear the deadly song and survive. As well as ordering the crew to tie him up, Ulysses tells them that, no matter what he says, no matter how much he threatens or implores them, they must not set him free.

The idea of the Ulysses Pact is for those times when we know that we will be tempted in the future to act against the values, instincts and interests that we have now. Unless we are unusually self-disciplined, we have this experience every time we embark on a diet, or exercise regime, or a course of learning: we want the good intentions of today to override the temptations of tomorrow. We adopt tactics such as purging our house of snacks, or putting gym and study sessions into our diaries. We lash ourselves to the mast of self-improvement and hope that the bonds are strong enough.

Read More
Are you overfitting your delivery decisions - and to the wrong dataset?
David Knott David Knott

Are you overfitting your delivery decisions - and to the wrong dataset?

Overfitting is a term from the world of machine learning. It describes the problem that arises when you train a model on a dataset, and use that model to make accurate predictions - as long as they are limited to that dataset. Unfortunately, the model starts to go haywire when you apply it to the wider world.

Imagine a fictional example: you wish to use data about students to predict their academic performance. You train your model on a class where there are several students called ‘Geoff’, and they all happen to be doing very well in their studies - there’s no reason for this: it’s pure coincidence. But the data doesn’t know that. When you make predictions about this class only, your model seems to work: it finds the high performing Geoffs. When you use it to make wider predictions, however, in a world where there are rather fewer Geoffs, and where being a Geoff is not a reliable indicator of academic performance, the model stops working.

Read More
Respect before beanbags
David Knott David Knott

Respect before beanbags

I have worked in some strange offices in my career. At a start up, I spent six months in a cramped office above a meat market, where arriving in the morning meant dodging large men in blood smeared coats carrying sides of beef. While working for a large UK bank, which had run out of space in its premises, I spent time in a business continuity centre, surrounded by banks of anonymous desks stretching away into the distance, waiting to be filled in the event of a disaster. As part of a confidential corporate restructuring project, I worked in an empty office scheduled for decommissioning and demolition, hoping that the security systems would keep working for long enough to let the team out in the evening.

And, because I have spent my career in enterprise technology, I have also worked in many environments which look as if they have been outfitted from the ‘digital’ section of the IKEA catalogue, full of bright colours, breakout areas, ping pong tables, expensive chairs - and, of course, bean bags.

Read More
Build systems like you hire teams
David Knott David Knott

Build systems like you hire teams

Despite advances in AI, software systems are not people. But perhaps we should sometimes treat them like people - at least when it comes to budgets and financing.

A couple of weeks ago, I claimed that building software is not like building a bridge, and that the analogy of construction which we use - which I use - so frequently, may be harmful rather than helpful. Rather less usefully, I also suggested that there aren’t any perfect analogies, and that the best way to think about building software is to understand the business of building software. I’m now going to contradict myself and suggest another analogy: that we should think about building software in the same way that we think about hiring teams.

Read More
Good standards are like a good starting word in Wordle
David Knott David Knott

Good standards are like a good starting word in Wordle

What’s your starting word in Wordle?

I use STEAM. It has a good combination of common vowels and common consonants, and for some reason I find it pleasing (something to do with steam engines?). There are words which are mathematically proven to be better, but I like this one.

In case you’re one of the few people who didn’t become familiar with Wordle during the pandemic, I should explain. It’s an online game where you have six attempts to guess a five letter word, and each letter in the guess is marked green, for a correct letter in the correct place, yellow, for a correct letter in the wrong place, or grey for a letter which is not in the word at all. It’s just about hard enough to give you a sense of achievement, but easy enough that you get the right word most of the time. It also has the virtue that everyone who plays the game worldwide gets the same word every day, making it feel as if you are all playing together - you can also share your pattern of green, yellow and grey without giving the game away.

Read More