HUM-3157
Professional Ethics and Environmental Protection
Lecture 10: Ethical Dilemmas in Engineering
Topics Covered:
• Defining ethical dilemmas.
• Techniques for resolving ethical dilemmas in engineering.
Learning Outcomes:
• Identify common ethical dilemmas faced by engineers.
• Evaluate and resolve ethical dilemmas using ethical frameworks.
What is an Ethical Dilemma?
An ethical dilemma occurs when an engineer faces a situation where there
is no clear right or wrong choice. Instead, they must choose between two
or more conflicting moral principles.
Examples of Ethical Dilemmas in Engineering:
1. A software engineer discovers a security vulnerability in a banking app
but is pressured by management to keep quiet to avoid bad publicity.
2. A self-driving car’s AI must choose between protecting its passenger
or minimizing harm to pedestrians.
3. A company collects user data to improve services but is tempted to sell
it for financial gain without explicit user consent.
Why is Ethics Important in Engineering?
• Ensures public safety and well-being.
• Protects professional integrity.
• Maintains trust between engineers and society.
Types of Ethical Dilemmas in Engineering
1. Conflict of Interest
• When an engineer's personal interests conflict with professional
responsibilities.
• Example: A cybersecurity consultant is offered money to overlook
vulnerabilities in a client’s system.
2. Safety vs. Cost
• Companies must balance safety measures with cost-effectiveness.
• Example: A car manufacturer knows a defect could cause accidents but
decides not to recall the vehicles due to financial losses.
3. Privacy vs. Security
• Balancing data privacy with security concerns.
• Example: Should a company prioritize user privacy, or should it allow
governments access to personal data to prevent cyber threats?
4. Professional Duty vs. Organizational Pressure
• Engineers may be pressured by employers to act unethically.
• Example: A software engineer is asked to manipulate algorithms to
favor certain customers unfairly.
Ethical Dilemma: Conflict of Interest
A conflict of interest (COI) occurs when an individual's personal
interests interfere with their professional responsibilities, leading to
biased decision-making. In computer science and engineering, this can
arise when a developer, researcher, or engineer has competing interests—
such as financial gain, personal relationships, or affiliations—that affect
their ability to act objectively.
Example of an Ethical Dilemma:
Imagine a software engineer working at a cybersecurity company who is
also a consultant for a startup that offers similar security services. The
engineer may face a dilemma:
• Should they disclose vulnerabilities found in their company's
product to their employer or use this knowledge to benefit the
startup?
• Should they recommend their company’s software to a client if they
stand to gain financially from the startup’s competing product?
Such situations raise questions about professional integrity, transparency,
and potential harm to the primary employer or clients.
Case Study: Google and Project Maven (AI in Military Use)
Background:
Google collaborated with the U.S. Department of Defense on Project
Maven, an initiative that used artificial intelligence (AI) to analyze drone
footage. The goal was to improve the military’s ability to detect objects
and people in videos.
Conflict of Interest & Ethical Dilemma:
1. Employee Ethics vs. Company Interests – Many Google
employees objected to working on military-related AI applications,
arguing that their skills should not contribute to warfare.
2. Public Image vs. Business Growth – Google wanted to maintain
its reputation as an ethical AI company while also securing lucrative
government contracts.
3. Transparency vs. Secrecy – The company was not initially
transparent about its involvement, raising concerns about corporate
accountability.
Outcome:
• In response to internal protests and public backlash, Google decided
not to renew its contract for Project Maven in 2019.
• The case highlighted the ethical risks of corporate involvement in
military AI and how conflicts of interest between business goals
and ethical considerations can lead to major dilemmas.
Key Takeaways for Computer Science and Engineering:
• Transparency is crucial – Professionals must disclose potential
conflicts to maintain integrity.
• Ethical guidelines should guide decisions – Companies and
engineers should follow ethical frameworks like ACM’s Code of
Ethics.
• Stakeholder interests must be balanced – A decision should
consider employees, customers, and society, not just financial gains.
Ethical Dilemma: Safety vs. Cost
In the fields of computer science and engineering, safety and cost often
come into conflict when companies must decide between implementing
rigorous safety measures or opting for more cost-effective solutions that
may introduce risks. This dilemma arises when ensuring safety requires
significant financial investment, potentially reducing profitability,
slowing down product development, or increasing operational expenses.
A key question in such situations is: Should a company prioritize
human safety over cost, even when the additional expense could
impact competitiveness or financial stability? Ethical frameworks such
as utilitarianism (maximizing overall benefit), deontology (following
moral duties), and virtue ethics (acting with integrity) provide different
perspectives on resolving this dilemma.
Case Study: The Therac-25 Radiation Machine
One of the most well-known ethical failures in computer science and
engineering related to safety vs. cost is the Therac-25 incident in the
1980s. This case highlights how cost-cutting decisions led to deadly
consequences.
Background
The Therac-25 was a medical radiation therapy machine designed to treat
cancer patients. It was a more advanced version of previous models,
featuring a fully computer-controlled system instead of relying on
hardware safety interlocks.
Ethical Dilemma
To reduce costs and streamline the machine’s design, the manufacturer,
Atomic Energy of Canada Limited (AECL), removed hardware safety
mechanisms, assuming that software would be sufficient to prevent
accidental radiation overdoses. However, the software had undetected
race conditions (timing errors) that sometimes led to massive radiation
overdoses—far beyond safe levels.
Consequences
Between 1985 and 1987, at least six patients received fatal radiation
overdoses due to the software bug. The machine failed to detect errors in
its operation and continued administering unsafe radiation doses, leading
to severe injuries and deaths.
Ethical Failures
1. Inadequate Testing: The software was not rigorously tested for
safety-critical failures.
2. Over-reliance on Software: Hardware safety interlocks from
previous versions were removed, making the system entirely
dependent on software, which contained critical bugs.
3. Ignoring Early Warnings: Operators and hospitals reported
malfunctions, but AECL downplayed the concerns instead of halting
usage and addressing safety flaws.
4. Failure in Ethical Responsibility: Engineers and management
prioritized cost and efficiency over patient safety.
Lessons Learned
• Safety-Critical Systems Require Redundant Safeguards: Both
hardware and software safety measures should work together.
• Thorough Testing and Validation: Rigorous software testing,
particularly in life-critical systems, is essential.
• Transparency and Accountability: Companies must take reported
issues seriously and act quickly.
• Engineering Ethics: Engineers have a duty to prioritize human
well-being over cost-cutting measures.
Conclusion
The Therac-25 case remains a stark reminder of the ethical dilemma
between safety and cost in engineering and computing. While businesses
aim to reduce expenses and optimize efficiency, compromising on safety
can lead to disastrous consequences. Ethical responsibility requires
engineers and companies to prioritize human lives over profit, ensuring
robust safeguards in all critical systems.
Ethical Dilemma: Privacy vs. Security
The ethical dilemma between privacy and security arises when the need
to protect personal information conflicts with the need to ensure safety
and prevent harm. Governments, organizations, and individuals often
struggle with the balance between protecting citizens' privacy rights and
implementing surveillance or security measures that may infringe upon
those rights.
• Privacy: The right of individuals to keep their personal information,
communications, and activities confidential.
• Security: The need to protect society from threats such as
cybercrime, terrorism, and hacking through surveillance and data
collection.
This dilemma is especially relevant in the computer science and
engineering field, where technologies like encryption, AI-powered
surveillance, and cybersecurity measures raise concerns about how much
personal data should be accessible to authorities or companies.
Case Study: Apple vs. FBI (2016)
Background
In 2016, the FBI requested Apple’s assistance in unlocking an iPhone
belonging to one of the shooters in the San Bernardino terrorist attack.
The FBI argued that accessing the phone's encrypted data was necessary
for national security. Apple refused, citing privacy concerns and the
potential risk of setting a precedent for government intrusion into personal
devices.
Ethical Dilemma
1. Security Perspective (FBI's Argument)
o The FBI claimed that accessing the iPhone could help prevent
future attacks and uncover important details about terrorist
networks.
o Allowing backdoor access to encrypted devices would aid law
enforcement in solving crimes and protecting citizens.
2. Privacy Perspective (Apple’s Argument)
o Apple refused to create a "backdoor" for the iPhone, arguing
that doing so would weaken encryption and make all iPhones
vulnerable to hackers.
o Once such a tool existed, it could be misused by governments,
hackers, and malicious actors worldwide.
Outcome
• The case escalated to public debate, with some supporting the FBI's
security concerns and others defending Apple’s stance on privacy.
• Eventually, the FBI managed to unlock the phone using a third-party
tool, bypassing Apple's cooperation.
• The case remains a landmark debate on privacy vs. security in the
digital age.
Conclusion
The Apple vs. FBI case exemplifies the ongoing struggle between privacy
and security in the field of computer science and engineering. While
security measures are essential for public safety, compromising
encryption and privacy can have far-reaching consequences for digital
rights and personal freedoms.
Ethical Dilemma: Professional Duty vs. Organizational Pressure
In the field of computer science and engineering, professionals often
face ethical dilemmas when their professional responsibilities and ethical
obligations conflict with the demands or pressures from their employer.
This conflict can arise when an engineer is asked to implement a solution
that is technically feasible but raises ethical concerns, such as
compromising user privacy, bypassing security protocols, or
engaging in deceptive business practices.
The ethical dilemma occurs when:
• Professional duty dictates that engineers follow ethical guidelines,
protect user interests, and ensure that software or hardware systems
are secure, fair, and transparent.
• Organizational pressure pushes them to prioritize corporate goals,
often at the expense of ethical considerations—such as rushing
development, ignoring security vulnerabilities, or prioritizing
profit over user safety.
Case Study: Volkswagen Emissions Scandal (Software Engineering
Perspective)
Background
In 2015, Volkswagen (VW) was caught in a major scandal where its
engineers had programmed emissions control software to cheat during
regulatory tests. The software was designed to detect when the vehicle
was being tested and alter its performance to reduce emissions artificially.
However, during normal driving conditions, the vehicles emitted far more
pollutants than allowed by environmental regulations.
Ethical Dilemma
• Professional Duty: Software engineers and developers responsible
for the emissions control system were expected to design accurate
and legally compliant software.
• Organizational Pressure: VW management prioritized
competitive advantage and market success over regulatory
compliance, pressuring engineers to create a deceptive system that
passed emissions tests.
Key Ethical Issues
1. Deception & Fraud: The software was explicitly designed to
mislead regulators and customers.
2. Environmental & Public Health Impact: The excess emissions
contributed to air pollution, impacting public health and the
environment.
3. Whistleblower Dilemma: Engineers who identified the issue might
have faced retaliation if they spoke out against their employer.
4. Long-Term Reputation Damage: VW suffered billions in fines,
lawsuits, and a damaged reputation due to ethical violations.
Resolution & Lessons Learned
• VW had to recall millions of vehicles and pay heavy fines.
• Some executives and engineers involved in the deception faced
legal consequences.
• The case highlighted the importance of ethical engineering
practices and whistleblower protection in corporate environments.
Conclusion
This case exemplifies how organizational pressure can push engineers
into unethical decision-making, even when they know it violates
professional ethics. It underscores the importance of integrity,
transparency, and ethical responsibility in the computer science and
engineering fields.
Approaches to Ethical Decision-Making
1. Utilitarian Approach (Consequences-based ethics)
• Choose the option that maximizes overall good.
• Example: If an AI system can reduce accidents but may cause job
loss, should it be implemented?
2. Deontological Approach (Duty-based ethics)
• Follow moral duties regardless of consequences.
• Example: Even if whistleblowing might harm your career, it should
be done if it's the morally right action.
3. Virtue Ethics (Character-based ethics)
• Decisions should reflect good moral character.
• Example: A good engineer should always strive for honesty,
integrity, and fairness.
4. Rights-Based Approach
• Ensures human rights and dignity are respected.
• Example: Does the AI facial recognition system violate people's
right to privacy?
5. Justice and Fairness Approach
• Ensuring fairness and equal treatment.
• Example: Is an engineer fairly compensating workers in a global
supply chain?
