Stories
Slash Boxes
Comments

SoylentNews is people

SoylentNews is powered by your submissions, so send in your scoop. Only 18 submissions in the queue.
posted by CoolHand on Thursday May 21 2015, @02:02PM   Printer-friendly
from the oh-the-inhumanity-of-it-all dept.

Algorithms tell you how to vote. Algorithms can revoke your driver’s license and terminate your disability benefits. Algorithms predict crimes. Algorithms ensured you didn’t hear about #FreddieGray on Twitter. Algorithms are everywhere, and, to hear critics, they are trouble. What’s the problem? Critics allege that algorithms are opaque, automatic, emotionless, and impersonal, and that they separate decision-makers from the consequences of their actions. Algorithms cannot appreciate the context of structural discrimination, are trained on flawed datasets, and are ruining lives everywhere. There needs to be algorithmic accountability. Otherwise, who is to blame when a computational process suddenly deprives someone of his or her rights and livelihood?

But at heart, criticism of algorithmic decision-making makes an age-old argument about impersonal, automatic corporate and government bureaucracy. The machine like bureaucracy has simply become the machine. Instead of a quest for accountability, much of the rhetoric and discourse about algorithms amounts to a surrender—an unwillingness to fight the ideas and bureaucratic logic driving the algorithms that critics find so creepy and problematic. Algorithmic transparency and accountability can only be achieved if critics understand that transparency (no modifier is needed) is the issue. If the problem is that a bureaucratic system is impersonal, unaccountable, creepy, and has a flawed or biased decision criteria, then why fetishize and render mysterious the mere mechanical instrument of the system’s will ?

http://www.slate.com/articles/technology/future_tense/2015/05/algorithms_aren_t_responsible_for_the_cruelties_of_bureaucracy.single.html

 
This discussion has been archived. No new comments can be posted.
Display Options Threshold/Breakthrough Mark All as Read Mark All as Unread
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
  • (Score: 3, Interesting) by Non Sequor on Thursday May 21 2015, @06:34PM

    by Non Sequor (1005) on Thursday May 21 2015, @06:34PM (#186140) Journal

    This problem already existed in legal theory. Bright line tests are clearer on what is and isn't allowed but ignore mitigating concerns on borderline cases. Balancing tests explicitly invoke a subjective comparison of multiple factors but people do not like trying to guess what someone else's subjective decision will be.

    Ultimately it's all governed by Kolmogorov complexity. Every problem has a complexity and every algorithm has a complexity. If you use an algorithm that is simpler than the problem, the quotient of the two leaves a residual problem. How manageable is the implementation of the algorithm and how troubling is the residual problem? There is no a priori answer to that question.

    --
    Write your congressman. Tell him he sucks.
    Starting Score:    1  point
    Moderation   +1  
       Interesting=1, Total=1
    Extra 'Interesting' Modifier   0  
    Karma-Bonus Modifier   +1  

    Total Score:   3  
  • (Score: 2) by sjames on Thursday May 21 2015, @08:44PM

    by sjames (2882) on Thursday May 21 2015, @08:44PM (#186193) Journal

    The problem is that reality is sufficiently complex that there is always a residual problem. As long as we recognize that in the form of making sure someone always has the authority to decide against the algorithmic result and that that person's attention can be called to any disputed case, it can be OK. Unfortunately, instead bureaucracies (government or corporate) are very careful to put up a wall of card flippers to thoroughly isolate anyone with a modicum of authority from the customer.

    • (Score: 2) by Non Sequor on Thursday May 21 2015, @11:56PM

      by Non Sequor (1005) on Thursday May 21 2015, @11:56PM (#186259) Journal

      You're still describing residual problems. These institutions have operational dogmas put in place in response to past problems.

      --
      Write your congressman. Tell him he sucks.
    • (Score: 2) by hendrikboom on Friday May 22 2015, @03:08PM

      by hendrikboom (1125) Subscriber Badge on Friday May 22 2015, @03:08PM (#186483) Homepage Journal

      A wise friend of mine once noted that no bureaucracy can work without the presence of people capable of breaking the rules.