Monday, August 25, 2014

Dealing with Complexity

Have you paused for a moment to marvel at some of the things we have been doing lately?

Self driving cars.
Drones that deliver packages.
Contact lenses that can measure eye pressure.
Gadgets that take pictures when you just think about taking pictures (yep, that exists).

Only fifteen years ago, I would not have thought this kind of stuff would come about while I was still alive. While I see the upside of all this - in fact I make a living out of the upside, I also see some downsides. This post is mostly about the downsides. It does not mean I am anti-technology. I am very much pro-progress, and I definitely think we are better off today than we were just 60 years ago. I also think that is true on most fronts - we have better medical care, better technology and definitely a better political climate. But I have my times of doubt, and this one such moment.

The first problem I see with such complex systems is the need for specialized knowledge before one can contribute anything. The more sophisticated the stuff you make, longer someone has to spend trying to learn all the basics before they can add on top of it. And once they get all that training, they are not going to easily adapt into another job, because they will need a bunch of retraining. Not many companies are willing to hire just "smart" people and pay they until they get up to speed. Most are looking for specific skills that they can start applying on day one on their new jobs. Instead of valuing experience, most places will hire people who have been "ready-made" for the specific roles they have. Once that ready-made position is no longer relevant, heaven help them if they need a new job.

The second problem is avoiding absurdities in the system. When building something complex, it is always difficult to make sure that all the parts make sense together. In the medical system here, it has come to a point where if you dont have medical insurance, you cannot see a doctor. And the number of times you are allowed to see a doctor for any reason whatsoever is also dictated by medical insurance. Take one of my experiences for example: I had a skin problem, which was on my face and my back. I wanted to see a doctor, and called a skin specialist to fix an appointment. They told me that the doctor could only look at one part of my body during one appointment (apparently the insurance restricts the doctor from looking beyond one specific problem). So I asked for 2 consecutive appointments so I could show my face and my back and avoid another trip to the same doctor on another day. Again, insurance prohibited the same doctor from seeing the same patient in two appointments on the same day. The only thing I could do was take appointments on two different days. What kind of nonsense is that?

The third problem is conveying this knowledge to common people. Take the financial system. I dont think anyone understands the entire system, fully, including the people who designed it. And because people like you and me dont understand it, you are supposed to get yourself a "broker" or a "financial planner" who will understand these things for you and make your life smooth. I recently attended a panel discussion organized by financial planners. Their biggest advice was to get yourself a financial planner and invest as much as you can in your 401k. When asked what a financial planner did, they said it is a "halo person" who talks to your accountant, lawyer, broker, doctor, nanny, knows your family and relatives and decides what the right financial decisions are for you. Apparently they control the actions of all these people on your lives so that financially, it all makes sense. What they dont mention is that they charge thousands of dollars in fees, just like all these other people in your life that they are supposed to "work" with, such as lawyers, accountants and so forth. A lot of people came out of that panel discussion feeling like they had a "lot to catch up on and do". I came out deeply concerned that (a) our system was so complicated that something so simple as "inheritance" required working with a financial planner, a lawyer and an accountant. Its something everyone has to do, so why dont we make it as simple as possible? Why make the system such that there is one loop hole that you can go through to make sure your money goes to your children without paying too much in taxes, but for that you need to do this complicated trust fund thing? Why not just offer everyone the same thing instead of limiting these options to those people who are educated enough to navigate the laws and have money to pay lawyers who know how to deal with it?

Of course, financial planners did not mention the fine print that they charge thousands of dollars for their services. I wonder if them and the IRS setup this system so that the IRS can take a cut out of all the money from people who dont know the system, and the financial planners can take the money out of all the people who learn a few things about the system..

When I was at IITM, there was a T shirt that was made by the students of the CS department that read "Complexities Simplified for Everyone". The complexity they had in mind when they made the Tshirt must have been the algorithmic kind... but that phrase indicates what we need on almost all fronts on which we have made progress. I wish all the new grads coming out of college in the coming years will figure out a way to simplify the various systems around us so as to make it more understandable to the common man instead of introducing more complexity when they join the workforce.