Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Ethics can’t be a side hustle (deardesignstudent.com)
135 points by fagnerbrack on Feb 21, 2018 | hide | past | favorite | 102 comments


I find that people in tech, especially in my own field of data science, treat ethics as a relatively simple problem. If they were building a technical product, they would at least make an appearance of checking assumptions, and worrying about breadth and depth of stakeholder buy-in, and building tests for unintended consequences. But when it comes to building an ethical "product" to guide their work, it's like all of the best-practices go by the wayside. For example:

https://www.wired.com/story/should-data-scientists-adhere-to...

Data for Democracy came up with an ethical code for data scientists and is now talking it up asking people to sign on to it. The thing is basically the product a few months of working groups plus a day-long hackathon, and it's already been put out on the market, so to speak. So it's not surprising that they produced something that could, in many ways, actually run counter to their goals. I firmly believe the ethical code as written is itself unethical:

https://towardsdatascience.com/an-ethical-code-cant-be-about...

What I've found amazing is that the community that built the D4D ethical code has been entirely unwilling to invite criticism of the code, or even engage with those who question it. The fact that willingness to entertain criticism and consider unintended consequences is actually one of the pillars of their ethical code makes it doubly troubling.


I think the “problem” is that ethical questions and nuanced thinking generally get in the way of “getting things done”. It seems that the software/startup/disruption community glorifies moving fast, shipping an MVP and then iterating on improving measurable metrics. None of these are conducive to dialectic and thinking carefully about consequences. Heck, the popularity of weak/dynamic typing and REPL-it-till-it-works shows that many programmers today aren’t willing to reason about effects even within their own code... leave alone societal consequences! Nothing wrong with that style of programming as such, but I think it’s a symptom of the ratio of thinking-to-doing that many find comfortable.

Software is unique in that it gives us the flexibility to fix bugs after shipping, unlike any other engineering field. Over the last few decades, we seem to have gotten increasingly carried away with emphasis on that feature. Also has to do with the incentive structure encouraged in SV.


I agree with this. There comes a point (much sooner than most people like to recognize) when quality and safety get sacrificed to just getting things done. However, I think that's a manageable risk. Most focus - and tooling - centered on analytic/technical design rather than implementation has the potential to catch problematic implementations before they're shipped.

https://towardsdatascience.com/data-is-a-stakeholder-31bfdb6...

It's not fool-proof, of course, and I think a change in perspective away from just moving fast and breaking things would be quite healthy for the industry as a whole.


I think the problem is, you can fix technical bugs after shipping. It's much, much harder to fix ethical bugs.


Exactly. The cost of fixing a bug after the product is out the door is much higher when the bug is ethical rather than technical. Therefore, don't move the product out the door so quickly. Ethical QA takes time.


I’ve been saying this a lot lately, but software needs a professional associstion (like the AMA) with teeth. Ethics are not easy, and without collective governing power, they simply won’t exist.

https://news.ycombinator.com/item?id=16423328

https://news.ycombinator.com/item?id=16420659


A think a governing body solves the wrong problem. Most of the ethical issues that have arisen around data science in particular are actually competency issues. It's not that someone deliberately set out to target already-vulnerable populations. It's that they designed systems without building in checks for unintended consequences. A governing body accomplishes what any legal framework accomplishes: it provides instruction and incentives to limit liability. A legal framework is different than an ethical framework. What we need is an ethical framework.

The original Hippocratic Oath did a fairly good job of this by stipulating ways that a doctor could prove his competence. Doctors who adhered to the oath weren't better doctors because they had some kind of internal moral compass or external adjudicating body. They were better doctors because only the doctors who had competency to spare were willing to make the sacrifices that adherence to the oath required.

https://hackernoon.com/on-the-difficulty-of-creating-a-data-...

Ethical problems get solved (as much as that type of problem can ever really be "solved") by individual practitioners refusing to work with other individual practitioners who refuse to adhere to some basic best practices. That creates a network of competent and trustworthy individuals, who are still totally fallible, but who put their own practice up toe constant public scrutiny.

Ethical problems are problems of systemic risk. Systemic risk doesn't get solved through organizations.


The governing body would not just be there to arbitrate, advocate, or negotiate. They would also be there for promoting training and sharing of knowledge.


I don't think training and sharing of knowledge is the problem. The problem is creating an appropriate incentive structure for maintaining trust in individual practitioners' competency. That doesn't happen in a top-down way. It has to be negotiated as locally as possible.


i want to stress that i'm not challenging the person, just the text.

> The governing body would not just be there to arbitrate, advocate, or negotiate. They would also be there for promoting training and sharing of knowledge.

this reads like duct-tape solutions. it's always the case that a governing body grows and grows and gets in the way. "it's not just there to XYZ, it also BLAHBLAHBLAH".

a governing body is one possible solution to the problem of people not understanding ethics (or how to figure out what ethics are), that I don't think will solve the larger problem.

a governing body will need to be run by practitioners of governance, and enforced by practitioners of enforcement.

ethics needs to be practiced everywhere, all the time. and a governing body won't make that happen.

people need to be learning about why their activities are "good" or "bad" or "questionable".

in my (simplified version) view: we're not lacking incentive to work (money!), we're lacking incentive to not work (people shouting at us for being assholes for doing asshole work [e.g. bombs, baby killing, evil algos]).

we need to cultivate behaviors of ethical culture... instead we're cultivating behaviors that promote short-term-ism (buy your way to happiness, bomb your way to safety, build your dream home on loan!, opportunity cost services saving us from having to cleaning up after ourselves, trash removal services that vanish things away to faraway dumps we never think of)


I honestly don't see what's "duct-tape" about suggesting that, being our organization, we'd get to decide how it's shaped.


I disagree. Not in principle, but because I think it won't work. If an organization has teeth in this market it will be turned into a weapon to gate out or remove competition.


So... competition > ethics?

Ethical software with less competition seems better than unethical software with more competition, eh?


I worry that Ethical software will lose out to unethical software. There is too much pressure and low-hanging fruit to do any kind of gate-keeping that won't be circumvented.

If you want to take the required measures to not circumvent the gate-keeper, that is strangling the entire sector. Since most developed countries see this sector as the basis for future growth, so doing that seems unlikely. Beyond that, the growth would probably move to less restrictive places.


I suppose the question is how much faith you have in oversight boards to actually produce ethical outcomes.

My worry wouldn't be "they'll cut down on competition to ensure ethical behavior", it would be "they'll block competition and protect their member instead of ensuring ethics."

I think the top-level essay here is extremely cogent: oversight is almost always limited to ensuring competence. In medicine, that gets us 'ethics' when ethics means "providing good care and avoiding bad care". (It hasn't gotten us ethics when the question is anything complicated, like defining mental illness.) Competence in data science and software is largely orthogonal to ethics, so I expect an oversight board would achieve very little in that regard.


What makes software so different from every other endeavor in that regard?


If I understand your question: nothing, professional associations become anti-competitive gatekeepers in every endeavor.

Roughly 30% of US workers have mandatory occupational licensing before they can do their jobs. Licensed services have roughly 15% higher prices than nonlicensed ones. Most of those workers are not in safety critical jobs - on average an interior designer faces more stringent licensing requirements than an EMT.

Unions and professional associations have consistently been the main lobbyists advocating professional licensing as a way to keep wages high (by keeping supply low) and guarantee a role for the organization. Even in medicine, the number of residency slots is controlled in a way that creates a stable, minor shortage of doctors.

I'm not against all licensing and oversight, obviously. I'd rather have a cap on residencies than untrained doctors, if those are the only two choices. But the history of 'every other endeavor' looks to me like a lesson in how oversight organizations will cause exactly this problem.


There is always a trade off, but each occupation learns the hard way thst it’s worth it. Hopefully software will figure that out in time to regulate itself before the government steps in with agendas and a heavy hand.


Scope


Medicine encompasses everything from practice to research, humans to non-human animals, procedures and devices to drugs and therapies, and touches nearly every human alive.

Engineering is even more diverse and penetrating, and software is merely a subset.

It ain’t scope.


I quit a job once, for a number of reasons, but one of them being that as I learned the intended application of the technology I was working on, I grew more and more ethically uncomfortable. I was initially lured to the company for the opportunity to work on cool technology (GIS, sensors, airborne mapping), but soon realized the stuff was being primarily sold to law enforcement for the purpose of, among other things, surveillance and immigration enforcement. So the end of the day I decided I don’t want my name to be associated with that. I don’t want to have to explain to my daughter one day (whose mother is an immigrant) that I was part of building an immigrant surveillance system. So I went and found something different to do.

There are lots of opportunities in software to take the ethical high road. Do I help the company try to sneakily get the user’s personal info? Do I help us cheat this benchmark? Do I hide our bugs by silently restarting the app when the user is probably not at his PC? (each of which I was asked to implement at one point in my career) Does what I’m programming sit well with my personal ethics and beliefs? I should be able to explain why I am writing the program i’m writing and be able to live with it. (EDIT)If I am the owner of a company and I’m interviewing someone and they worked at some company notorious for using dark patterns or anything else ethically questionable I think it’s fair game to ask about their involvement.


I don't think this is a straightforward as the author claims. I'm sure there are plenty of people at Uber who believe that governments are acting in an oppressive manner by trying to come down hard on Uber. Not that I agree with that stance, but there are multiple ethical stances that co-exist in this world - that's why politics isn't a solved problem.


I think it's less of a gray area than that. Anyone at Uber who worked on Greyball, perhaps telling themselves that they were thwarting an oppressive government who was firmly in the pocket of the taxi lobby, was naïve at best and deceiving themselves at worst. Maybe some people got caught up in the cat-and-mouse game of evading authorities and failed to question whether what they were doing was "Good." That's the author's call to action in this piece: to remind us to step back and evaluate what we are doing in an ethical context.

Things seem less gray for the author's second example- developers at Palantir designing a workflow to help ICE round up immigrants. Of course there is room for counter-points in an argument about how best to handle an immigration crisis in any country (I say "crisis" because I see it as a crisis that we are doing so little to help) but at the end of the day, our individual actions need to be made on the basis of an single ethical black-or-white question, and history and indeed the present will not look favorably upon those who fail to act in the best interest of their fellow humans.


while I agree with you, you have to remember that the current administration and many of their supporters support ICE's actions. What you're arguing for is that the actions of Uber or Palantir's designers are against your personal ethics, or those of the wider movement you identify with.


Both can be true. I do believe anyone supporting the administration's efforts on immigration and many other issues, and anyone working to assist ICE in these efforts, etc to be acting unethically.

I think there is such thing as an ethical Ideal, and my own ethics are an attempt to get as close to the ideal as possible. I like to think that they don't exist in a vacuum.


Is it unethical to follow law? Is it ethical to break a law you personally don’t agree with? The whole way society works is that we all agreed to follow the system even if we don’t always agree with that it says all the time. You can say whatever you want about it freely. When it’s real naughty we’re supposed to end it.

Selective enforcement of the law is actually unethical. If you don’t like it, you need to work to change it. Saying something is unethical just because you don’t like it is not rational. Moritality is personal, ethics are societal. Maybe your morals state open borders should be a thing, but our shared ethics don’t.

In this case, immigration law is messed up in both directions. Why do you feel like you feel like you should judge the side following the rules? Are the people who support the people following the law unethical too?


I have no idea how people can believe this kind of thing. The law is not in anyway ethical. Most of our law was handed down to us by monarchs and slavers. Almost no one agreed to it. We get a performative charade once every couple years which pretends everyone has agency in changing it. People who actually try to make real change, however, are usually murdered or locked up and forgotten.


I don't believe selective enforcement of the law is unethical, if enforcement of the law would be immoral. However, criminalization of acceptable behaviour with an aim to selectively enforce it for some other motive may be immoral. E.g. if you wanted to imprison a particular race, so criminalised something acceptable which everyone does, and more aggressively policed that race.


It depends as Seward said "There is a higher law than the Constitution"

And Soldiers are legally obliged to not obey illegal orders


How do you feel about identity theft? Is it ethical to take measures to reduce identity theft? Note that ICE is very strongly involved in reducing identity theft.

How do you feel about a living wage? Is it ethical to take action against people who cause wages to fall below a living wage? Note that wages go up when ICE removes people who are pushing wages down.

How do you feel about unemployment for black Americans? Is it ethical to help them by making more jobs available? ICE does that.


You seem to be implying that morality is subjective, which I think is a dangerous belief. People may believe their actions are ethical, but that doesn’t necessarily make them correct.


What could be an objective basis for morality?


Jonathan Haidt's work on "Moral Foundations" could be worth investigating. They determined 5 major cross-cultural "moral foundations," to which each person assigns various degrees of importance: Care, Fairness, Loyalty, Authority, and Purity, suggesting these stem from a biological/neurological source. From Wikipedia:

> Haidt and Craig Joseph surveyed works on the roots of morality... From their review, they suggested that all individuals possess four "intuitive ethics", stemming from the process of human evolution as responses to adaptive challenges. They labelled these four ethics as suffering, hierarchy, reciprocity, and purity. According to Haidt and Joseph, each of the ethics formed a module, whose development was shaped by culture. They wrote that each module could "provide little more than flashes of affect when certain patterns are encountered in the social world", while a cultural learning process shaped each individual's response to these flashes. Morality diverges because different cultures utilize the four "building blocks" provided by the modules differently.

Perhaps these four "building blocks" -- suffering, hierarchy, reciprocity, and purity -- are sufficient for an objective basis upon which an intersubjective understanding of morality can be determined.

Then again, even the notion of objectivity is questionable and culturally-dependent...


Okay, but it's important to note that studying the evolutionary and neurological bases for morality give us a description of morality, not a prescription for morality. In other words, Haidt can only describe how people behave, he can't prescribe how people should behave.

There's a big logical leap between (for example) observing that many cultures proscribe lying, and saying that one shouldn't lie.


God or nothing.

See Arthur Leff's article: http://digitalcommons.law.yale.edu/fss_papers/2814/


If its god or nothing, then how do you explain the fact that most philosophers are both atheists and moral realists?


There are two cases I've seen:

1. Some philosophers have a descriptive ethic (this is what people do) rather than a prescriptive ethic (this is what people should do). This is certainly interesting, but it isn't what most people mean when they talk about ethics--it doesn't give us any guidance on how to behave ethically.

2. Some philosophers try to work backward to a prescriptive ethical principle from a set of ethical prescriptions which are widely accepted but, importantly, unproven. For example one might start from the prescriptions "murder and lying are wrong, giving and learning are right" and attempt to come up with a prescriptive ethic that unites these prescriptions. But "murder and lying are wrong, giving and learning are right" aren't objective facts even though they're widely accepted, so any prescriptive ethic that comes from these prescriptions can't be objective either. It's not coincidence, for example, that in the west, the atheist/moral realist philosophers mysteriously often start from Judeo-Christian prescriptions.


Sam Harris has a book about exactly that: https://en.wikipedia.org/wiki/The_Moral_Landscape

Even the "Christian Post" will agree he's "partly right": https://www.christianpost.com/news/atheist-sam-harris-right-...


My impression of Harris' morality from videos I've seen of him is that, like most ethicists, he's attempting to work backwards from existent ethical prescriptions to find fundamental prescriptive ethical principles. The fact that he's sourcing the ethical prescriptions from scientific method rather than religion means that the prescriptive ethical principles he arrives at are more palatable to people like me who practice science and not religion. But he's still starting from the unproven assumption that the ethical prescriptions he's started from have objective validity. As such, I don't think he's arrived at an objective prescriptive ethic any more than anyone else. I think you should practice the scientific method if you want to understand and operate in reality, but I don't think that practicing the scientific method is an ethical imperative.

That said, I haven't read the book you mentioned, so there might be something in that book which isn't in his talks which would persuade me.


I don't believe that myself, but I do believe that people advocating for a specific ethic are usually supporting their own point of view, which may be closer or further away from the ideal.


History is full of atrocities (and milder bad behavior) committed “by the people currently in power” with strong popular support.


...using tools and weapons developed by the last regime.

If we're that worried about abuse of power, we need a better conversation than "that guy is bad; vote for our guy". We need to talk about actually reforming systems, laws, and norms.


Well, yes. The thing is, if you believe that ICE is bad or you are about to complain that a doctor ignored some regulation, you should not work for Palantir or Uber.


Well, the irony of those two examples is one is using tech to skirt laws and the other to enforce laws. It's hard for me to consider both of them unethical at the same time without resorting to raw partisanism.


I don't think there is ethical need to follow laws you find despicable. I think that one should follow laws as long as those laws don't require you to do something bad. And there is no ethical requirement to contribute to law enforcement - it is not even against the law.

You can also agree with law and find agency tactics bad.


Yes, but what is "bad"?

Maybe I find it despicable that I can't scam you out of money if you happen to be dumb enough to let me. There are actually cutlers int he world that are "shame on you if you get scammed"

That is the entire problem when you talk about ethics at all beyond a few truths that 99% of people can agree on.

So one could argue not following any law becomes unethical -- and the only ethical thing to do is follow the law until it is changed, which puts us at a interesting juxtaposition -- that sometimes you have to be unethical to be ethical!

This will always be the hard part of making rules or laws on things that are so subjective such as ethics.


When we talk about my personal ethics or morality as a developer, I do not need wide consensus over the issue. It is about what I personally will or will not do. Or under which circumstances would I do it. The discussion with others does help me to decide and they can bring arguments I did not considered, but decision is mine.

There is wide agreement about many ethical questions through. I also think that ignoring ethics question completely is easy cop out - yes one should do it no matter what job.

I don't think that law and ethics is the same. I think that following law is ethical where law species competition rules (accounting, regulation etc).


I don't think I can completely agree with that. Should a meatpacker who skirts food safety regulation get an ethical pass because they believe government regulation is despicable?

I think the more ethical stance would be to advocate for changing the law.


I would give "ethical pass" when when law is forcing you to do something unethical. When you have choice between ethics and law (and it is important big ethical thing).

I don't give "ethical pass" for not following law where you merely disagree with law or find it pointless or an obstacle to more money.

There is also difference between "breaking law" and "not joining effort to enforce the law". Again, if I find the law bad it might be unethical to join effort to enforce it, but it might still be fully ethical to follow the law and unethical to break it. For example, unnecessary hygiene food regulation.

Easy to see extreme example of law to break would be anti-jew law or fugitive slave law or something like that. The point is that breaking law is ok not merely when you disagree with law, but when it forces you to break ethics. Not just when you benefit from breaking it.


Why not? They're two different situations.


I'm the one asking "Why?" in effect. I can't answer your question since it would be effectively answering my own.

I think the Uber example in particular assumes that following laws is itself essential. But opposing immigration laws and enforcement of them undercuts that axiom. I don't see how people resolve the tension there in a philosophically coherent way.


Not all laws are created equal. I personally condemn both actions, as I find them both to be quite harmful.


What makes taxi rules fair but immigration rules unfair?


It can be argued that in one case, skirting the law results in arguably better service for happy customers. In the other case, enforcing the law results directly in human misery and torn apart families. This is why it’s questionable to use “legal” as a substitute for “moral” or “ethical.”


Families are never torn apart by American immigration law. There is nothing in the law that prevents an American citizen from leaving the USA. If they won't leave, then that says something about how much they value the family.

You could make a similar argument for any crime that results in prison time. Locking up murderers results directly in human misery and torn apart families. This case is far more severe: we don't allow the family to move into the prison to live with the criminal. We even separate nursing babies from their mothers.


The responses here seem to have gotten into the weeds of specifics, but I think this is a fundamental point. A code of professional ethics will never get traction if it tries to be a code of personal ethics as well.

If you put personal ethics into a code, there are roughly two possibilities. One is that you put in things that were already censured at another level ("we oppose convicted serial killers") and nothing changes. The other is that you put in things which are actually contested ("we oppose all lawbreaking"), and then everyone who disagrees breaks away from the whole code, and probably benefits by working with people who support their stance.

A useful professional code tells you how to define malpractice, not immorality in general. Since professional censure and lost reputation are the consequences for breaking such a code, it had best be limited to actions which impugn the professional merit of the person committing them. That way, enforcing it is natural and self-interested; clients don't want to hire code-breakers, and other professionals don't want to be tainted by association.

I think medicine is instructive. People hold up the field as a successful example of bounding personal morality, but the Hippocratic Oath is very much a professional statement. It happens that professional behavior for doctors produces a very clear good - lives saved - but this is not actually a feature of the code. The Oath demands that the practitioner offer their subjects competence, confidentiality, and fiduciary duty; nothing more. Questions of personal morality in the workplace go unanswered, and so the Oath outlasted massive corrections in what is moral, like ceasing to treat homosexuality as an illness.

Appealing to personal morality in the workplace is fine, but it's not the same as appealing to a professional standard.


> that's why politics isn't a solved problem

There's another problem: under certain viewpoints, it's unethical to not send the bastards to a concentration camp, gulag, etc.


Except not all viewpoints are valid or true. If (as a vast majority of philosophers think) morality is objective, then those people are simply wrong about what is ethical/unethical.


Error theorists would argue that no moral viewpoints at all are true.


I'm not sure what implications you want people to draw from that statement. It's hard to argue that murder is OK, for example, so it's hard to argue that laws are all subjective expressions of power.


But your example is begging the question. If you frame killing a human being as murder, you've already decided that it's unjust or unlawful. How about the death penalty, euthanasia, extrajudicial execution, war, honour killing or jihad/crusade? In all those cases, the killing party believes their actions are fully justified.


Isn't that just a tautology, though?

I mean, if someone says "No moral viewpoints are more or less true than others; a person acts ethically as long as they think their actions are fully justified" and "People only do things they think are fully justified" then immoral action is impossible.


Nobody argues that there is no such thing as murder. It's not begging the question just because people don't agree about edge cases.


You're right; I don't think anyone here is arguing murder isn't real. The argument is that murder is not an objective truth, but rather a subjective truth. This doesn't mean we shouldn't care about murder, just that murder is a conceptual reality.


I was only drawing attention to an alternative meta-ethical philosophy. You can't talk about murder objectively because murder is subjective. In a legal context, jurisdictions differ over what circumstances make a death considered murderous, just, accidental, or even causal.


Perhaps a closer to home viewpoint for Americans would be: whether it's unethical / unjust to not execute a murderer.


a swift and painless death is ultimately more humane than a lifetime behind bars with no hope for release, imo.

unfortunately the US system combines the worst of both worlds. the few who are executed only die after years of agonizing "will they or won't they" through the various levels of appeal. and after all that we still end up exonerating people posthumously.


> a swift and painless death is ultimately more humane than a lifetime behind bars

Many would argue it's unethical for anyone to make that decision on someone else's behalf. The fact that so many death row convicts appeal their death sentence until the bitter end would imply that they themselves don't agree with your belief.


> The fact that so many death row convicts appeal their death sentence until the bitter end would imply that they themselves don't agree with your belief.

it doesn't necessarily imply that. at each point in the appeal process, there remains the possibility of having one's case thrown out altogether or reducing the sentence even further than natural life. even if you prefer death to life in prison, it would still be rational to pursue any chance of getting out entirely or getting a substantially reduced sentence.

that said, if I could implement any policy I wanted, I would choose for life to be the most severe sentence but give the inmate the ability to choose death if they prefer.


of course, and ethics and politics can not only be radical or common for their time but with the shifting of the overton window, historically radical or common views can switch places (consider the radicality of being a monarchist now, or a modern liberal in 1400AD).


Jumping straight from the politics of taxi regulation to nazis and death camps. Right.


If I were discussing the politics of taxi regulation, I'd be ashamed of my comment. But I'm not. It's a general observation on the difficulty of defining what is ethical and how even those who call for ethics can have different ethical systems/principles - not even prompted by the text itself.

Honestly, adding disclaimers, hedges and requests for charitable readings in every reply gets old.


Perhaps it would be worthwhile, then, to speak in ways which require a less exceptional effort of charity on the part of your audience. I mean, I have no idea what point you were trying to make by that, but I totally get why people reacted badly to it. It seems on balance to be adding much more heat than light, and I think there might be an interesting conversation here which is not yet being had as a result.

(eta: I see in my first reading of the thread parent that I missed a negation, which rather changes the sense of the thing. Prior statement stands, but I no longer feel the need to eye you suspiciously sidewise as I say it.)


There is pretty widespread consensus on the difference between topics where different viewpoints are valid and acceptable (taxi regulation) and not so (murdering people that didn't commit any violent crimes). There is no difficulty in allowing different ethical systems and still have some boundaries on things that a certainly unethical.


> pretty widespread consensus on... where different viewpoints are not so valid and acceptable (murdering people that didn't commit any violent crimes)

I take your point, and I agree that it's worth separating debate over practicalities and small influences from debate over basic humanity. One allows for "but I still think you're well-intentioned" and the other doesn't, so only one can be sustainable within a community.

But... it's also worth remembering how far from universal even our consensus views are. I can think of a half-dozen contexts in the world today where people explicitly reject the proposition "it's wrong to murder people who haven't committed violent crimes". In many of those contexts, they're serious enough to actually go out and do that murder, and be judged favorably for doing so.

I don't disagree with you, I'm not going to knowingly invite those people over to dinner. I just think it's worth remembering how little of morality is certain across times and cultures.


I think our economic model is highest on the list of needing an ethical makeover. If the person on one end of the supply-chain makes 1000000x as people on the other end of the supply-chain, then it's time to scratch our heads and deeply investigate what's wrong and how it can be fixed.

We can do ethical work within our current economic framework all day long, but that's not going to solve the most pressing ethical issues.


What economic model with higher aspirations actually ends up in more ethical place?


Why do you think that model is ethically wrong? If every link in the chains is compensated fairly (no one is coerced) and value is added, it seems like an inevitability that one end of the chain would be magnitudes larger in compensation.


There are a billion assumptions wrapped up in those statements. I will address some of them.

1. Every link is NOT compensated fairly. Wages have been stagnant for decades; meanwhile, the cost of everything else (especially housing) continues to rise, sometimes astronomically. $7.25 is the federal minimum wage, and it is impossible to live on.

2. Plenty of people are coerced into enduring terrible employment simply because they need to survive. I get it, Walmart needs employees too, but they should be in a union. It shouldn’t be possible to fire something and hire them back to start them back at the lowest pay grade (yes, this is a real thing they actually do).

3. Capitalism doesn’t exist in a vacuum; nothing does. The Randian “well, everyone’s trading value for value” falls apart the minute you look at a $10,000 MRI bill, or a $7.25 minimum wage, or an entire city that’s been destroyed because production moved overseas. It doesn’t particularly matter how much stocking shelves “is worth”; if you are alive, you don’t deserve to live in squalor and poverty in the richest country in the world.


> 1. Every link is NOT compensated fairly. Wages have been stagnant for decades; meanwhile, the cost of everything else (especially housing) continues to rise, sometimes astronomically. $7.25 is the federal minimum wage, and it is impossible to live on.

If I offer you $1 for your banana, and you agree and then we exchange the $1 and the banana, is that not fair?

> 2. Plenty of people are coerced into enduring terrible employment simply because they need to survive.

Are you arguing that 'providing for yourself' counts as coercion? What actor is doing the coercion?

> I get it, Walmart needs employees too, but they should be in a union. It shouldn’t be possible to fire something and hire them back to start them back at the lowest pay grade (yes, this is a real thing they actually do).

Are they agreeing to be re-hired?

> 3. Capitalism doesn’t exist in a vacuum; nothing does. The Randian “well, everyone’s trading value for value” falls apart the minute you look at a $10,000 MRI bill, or a $7.25 minimum wage, or an entire city that’s been destroyed because production moved overseas.

Why? MRIs provide a lot of value! Minimum wage effort provides low value.

> It doesn’t particularly matter how much stocking shelves “is worth”; if you are alive, you don’t deserve to live in squalor and poverty in the richest country in the world.

Why? You're implying that being born in one place or another changes what you 'deserve' as a human being. That's an interesting, but scary line of thought!


I'll hop in. Net value-add across the entire chain doesn't imply local value-add. And it's deeply short-sighted to be fine with certain sectors of people collapsing so long as the GDP has a net increase.

Two individual actors agreeing to a price doesn't make the price fair, and it ignores the larger economic/political arena that surrounds them.

Following the MRI example: nobody in this thread is suggesting that those don't provide value.

One poster is suggesting that such expensive operations should be subsidized through other mechanisms that take the larger economic/political arena into account (living, capable workers provide more value than sick/dead ones).

The other poster is suggesting that a low-wage laborer doesn't deserve to have an MRI because they can't individually afford it. The latter is a weak argument intellectually (let's not even _try_ to develop new mechanisms that include more people), morally, and economically (assumes that markets are free, efficient, and devoid of history).


You're wilfully ignoring the substance of the comment you're replying to which makes me think you're acting in bad faith.

There is an argument to be made that the US' economic system is fair. I disagree with that position, but it isn't completely unreasonable.

But your argument simply "proves too much". Your definition of "agreement", for example, includes a hostage agreeing to pay the ransom. It would also cover child labor, any form of discrimination, selling yourself into slavery, the abolishment of all labor standards including safety laws, shrink-wrap TOCs, non-compete clauses, forced arbitration for all disputes etc. etc.


> You're wilfully ignoring the substance of the comment you're replying to which makes me think you're acting in bad faith.

I'm not.

> There is an argument to be made that the US' economic system is fair.

I myself wouldn't agree that the US economic system is totally fair - there are cheaters/liars/coercion/exploitation everywhere. There are lots of things that are unfair, but choosing to work for minimum wage is not one of those things. An entrepreneur making 10000 more than someone else in the chain is also not one of those things, in my opinion.

> But your argument simply "proves too much". Your definition of "agreement", for example, includes a hostage agreeing to pay the ransom. It would also cover child labor, any form of discrimination, selling yourself into slavery, the abolishment of all labor standards including safety laws, shrink-wrap TOCs, non-compete clauses, forced arbitration for all disputes etc. etc

I'm deliberately excluding situations like this where actors are being coerced, so my examples do not include hostages, child labor, slavery, etc. Those are crimes for a reason and excluded here. See my original comment for where I omitted acts of coercion.


"If I offer you $1 for your banana, and you agree and then we exchange the $1 and the banana, is that not fair?"

Not an apt comparison. We're in a world where one is forced to take employment in order to try to survive. Thus, people find them in the situation where they are forced to accept any deal or starve. There is no ethical world where you can call that fair.


> We're in a world where one is forced to take employment in order to try to survive.

That's very true. You must do something if you want to survive. Your chances of surviving probably go up if anyone else values that thing that you choose to do.

It seems like this argument has devolved into 'by existing, I should be able to survive at the status quo of the wealthiest nation on earth in human history.' If that's where we are at, I have nothing else to say.


Why should it not be possible that every link gets compensated similarly? Is value added at the end of the chain necessarily much larger than that at the start of the chain?


Because value is not added equally along the chain.


There will naturally be variation, but why is it inevitable that there are order-of-magnitude differences?


It's not inevitable. It's just likely. If we're talking about a supply chain of "2" (banana example), it's not very likely. If we're talking about a supply chain with hundreds or thousands of actors (for example, smartphones), it's more likely.


Why is that an inevitability? What is unnatural about a supply chain where someone makes item A for $10, takes $2 profit, wholesales person B takes another $2 profit, final salesperson C takes $2 profit?

For products that are actually made and sold in the same country that's not far from reality today. It's just that for most things, they are made in Asia, and income/wealth disparity means the US/Europe end of the chain "has to" take much more of the profits to survive. That doesn't mean its fair, or just, or ethical.


Is it not possible that you need people of an exceptional caliber to be at the head of a large corporation. Here is one article that argues as such: https://hbr.org/2017/10/why-is-ceo-pay-rising-maybe-there-ar...

Now is that problematic? It feels wrong they earn so much more than the average person. Notably, these people earn so much more; not because they are proportionally better. Instead, it is because people at their level are proportionally rarer (if we believe the article).

The question I have regards the value they add. We need these rare people to head huge companies, but why do we get these huge companies? Is it because they are just better economically (economies of scale), or is there some other force biasing companies to be larger.


It's mostly not a problem of ethics.

That 1000000x is what you get from allowing corporations of unlimited size. Each level of management will earn what the lower level earns times some factor... making it exponential as you climb the corporate ladder.

Huge corporation size also means you get corporations blackmailing congress to get bailouts. The typical huge corporation is also able to engage in monopoly/monopsony behavior.

To make things extra awful, the largest corporations are the ones that are most difficult to split up. They have political power. Enforcing our anti-monopoly laws mostly doesn't happen.

Possible fix: the larger the company, the higher the tax rate, causing companies to want to split themselves.


I'll also chime in that employment regulations, labor taxes, and bureaucratic complexity in general benefit larger companies on average and hurt smaller ones.

I think a great proposal is to make it easier to disrupt big corporations. But that's not generally the tone people have when discussing these issues.


> ”And they don’t mean “good” as in quality. They mean good as in “on the side of the angels.”

That is a fundamentally huge misunderstanding of ethics, confusion between ethos and pathos. Ethics is about doing the right thing even if in opposition to your personal beliefs. There is nothing necessarily ethical about activities in fulfillment of a cause.

This isn't the problem I most prominently see in software with regards to ethics or product quality. I far more frequently see people half-assing product quality in order to make timelines and either keep their jobs or fulfill some qualitative metric that earns a larger annual bonus.


So what if you don't directly work on a product you consider unethical, but you know that others in the company do? Sure, you're not working on it directly, but you're keeping a company alive that does. But where else to work? What if the company you're working for isn't directly creating products you consider unethical, but is e.g. a customer at an unethical bank, or creates products that help companies that produce products you consider unethical?

And what if you work at/for such a company, but you're not a programmer, but e.g. a cleaner, are making ends meet, and you're lucky to have a job in the first place?


I would suggest the answer is: if it was easy, it wouldn't be ethics.


Generally: if the company is pretty self-evidently evil, and you have feasible alternatives, choose those alternatives.

Also, hypotheticals are fairly unhelpful compared to real cases.

Consider whether you would personally carry out the acts involved - would you defraud middle america for your own benefit? Would you fire on civilians on behalf of a dictator buying your product?


> ”And they don’t mean “good” as in quality. They mean good as in “on the side of the angels.”

And the author means "angels" as in "people who share my very specific political beliefs".

> You can’t help Uber build Greyball during the day, or help Palantir design databases to round up immigrants as your main gig, and then buy ethics offsets by doing a non-profit side hustle.

If I was a US citizen, and had an opportunity to work on software that helped enforcing immigration law, I would feel pretty proud about it.


You may disagree with the author's political beliefs, but you also aren't the subject of the author's critique.

If you help design or write a portion of a product, you are a crucial part of bringing the system into reality. If you support and believe in the mission and ends of a product, there's no issue there.

The problem occurs when you work on a system that is designed to fulfill an outcome that you don't agree with, or one that you believe is bad for society. The author's thesis is clear: If you choose to contribute to the development of such a system, you cannot divorce yourself from the consequences that will follow when your work product is turned on.

[edit: I'm not arguing for moral relativism; I'm trying to separate the argument from the concrete examples given in the piece.]


Can you imagine a doctor not telling you about a dark spot they found on an x-ray...Can you imagine an auto mechanic not telling you your brakes are shot because they didn’t want to deal with the problem...

The problem with these examples is that doctors and mechanics have a direct relationship with their customers while software developers do not. Not unless the developer is a freelancer.


Doctors and mechanics have professional societies and/or licenses. It's not as abstract for them. They go out of business for many unethical behaviors.


Well said.




Consider applying for YC's Winter 2026 batch! Applications are open till Nov 10

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: