Monday, November 30, 2020

Book review: Ethical Algorithm

This Book provides a layman's perspective on algorithmic decision making and social values like Privacy, Fairness, Transparency and Interpretability, Morality, and Safety. It is a highly recommended read for anyone who wishes to understand the pitfalls of Artificial Intelligence and Algorithmic decision making. The best part is that the authors have explained complex mathematical and probability concepts in a layman's language so that even a social science reader can understand it well.

Each chapter is dedicated to a specific theme. For instance, the first chapter on privacy discusses the pitfalls of privacy conversation. It explains how solutions like anonymization are incomplete. It gives examples of Arvind Narayan's Netflix research, legal pitfalls of movie database records, etc. It is interesting to know that despite anonymization, any person can be zeroed upon with 6 geolocations in the entire day. It argues about the issue of privacy vs predictive accuracy and explains the solution of using differential privacy as a regulator knob. 

Similarly, the chapter on fairness is filled with numerous examples. The book is engaging in its analysis and explanations. It has tried to bring out both sides of the arguments. W.r.t. Fairness, the book has beautifully explained the challenge of describing what is fairness and synthesize the entire discussion in form of pareto curve and pareto frontier. The definition of fairness as equality of false positives or euqality of false negatives is best explained using this. In this, author also highlights that science can provide the trade offs between different definitions of fairness but ultimate decision would hinge on human wisdom.

One chapter was dedicated to algorithmic game theoretic where authors explain issues in prisoner dilemma. It explains how technological solutions like Waze and Google Maps are promoting self interest over social welfare or competitive equillibrium. It also highlights other issues like eco chammberedness in machine learning and recommendation engines. Further suggestions like Cooperation through correlation are given as example.

Book also provided insight into email scams and how adaptability and scale is being used to fool people about market prediction. The concept of p-hack and garden of forking paths highlights the issue of false scientific research in the community.

Overall the book is an interesting read with umpteen examples, simple lucid language and open ended perspectives. A must read for folks who wish to know about various pitfalls of algorithmic processing and AI-ML.




Paradoxical life

 If I have ambition, how can I be relaxed?

If I am relaxed, how can I fulfill my ambitions?

If I am cool, how can I  be disciplined?

If I am disciplined, how can I be cool?

How can I be passionate without being focused?

How can I be focused without being passionate?

How can I be consistent without being goal-oriented?

How can I be goal-oriented without being consistent?


Courage to continue

UPSC is touted as one of the toughest exams in the world. Nearly 10 Lakh people appear for preliminary exam and hardly 15000 make it to Mains. Out of which some 2500 appear in Interview and finally 1000 of them become a civil servant and out of this 100 are IAS. Most of the rest rewrite the exam. So effectively out of 10 Lakh, nearly 9,99,900 either give up or rewrite the exam. So a failure in UPSC is nothing but a routine thing. It should not depress anyone. One should not feel any lesser human or less talented or depressed or any way inferior.

Success is not final. Failure is not fatal. It is the courage to continue which counts. If you think you can then you can else you are right. The harder you work the luckier you get.

We have enough examples surrounding us. Sridhar, Abhishek, Nitesh, Ravi, Amit Gemawat, umpteen number of them. Many people flunked prelims 3 times and became IPS in 4th attempt. And you have examples where people appeared to interview 4 times and could not become IAS. people who appeared 3 times but could not clear the exam. So moral of the story: Result is not in your hand. So then what is in my hand? Effort. Persistence effort. Determined attitude to give my best. Make every minute or the second count.

The question is why? No exam which makes you impactful. Money, fun, contribution to nation-building, every job offers all this. What makes Civil Services special is you can actually do some productive work. If a lady comes to your office, your one direction can get her justice. Your one surprise visit to the health center can help in the immediate improvement of services for thousands of people. At such a tender age, you can lead the entire district 10-20 lakh population. Your every walk and talk can become a source of inspiration for hundreds and thousands of others.

If you have this conviction, then no failure can stop you. Rarely  20 people become IAS on the first attempt. Rest all are in the same boat as yours. so don't worry. Take it as an opportunity to take lead for next year's examination.

I designed this survey for students to trigger self-introspection


Civil Service Exam is a test of (Choose one which you think is most important)
What is the most desirable quality in an aspirant? (Choose one which is most important in your view)
What is the foremost quality of a Civil Servant? (Choose one which is most prominent. we know it is a mix)
Why did I falter this year?
After prelims failure
For the next 7 months
Will you be writing mains at some point?
How much prepared I am for Mains subject?
How much prepared I am for Mains GS?
How many days I have wasted doing nothing after the prelims result?
What are some crucial traits helpful in winning a competitive race?
What do I need to do to clear next year's exam?
How to make the best out of the remaining time? (Mark only those which apply to your plan)
When I look at Laxmikant and Spectrum, I feel like
Who is an ideal study partner?
Study partner (choose most appropriate)
How frequently do I check social media? (Choose the closest)
Social Media (Insta, Facebook, WhatsApp, TG)
Best way to control social media
The biggest obstacle in my preparation
Why am I preparing for civil services? (Choose one which is most prominent. Do not go by the social desirability factor.)
Any comments