Civil Law And Ai Governance System Malfunction Liability In Europe .
Civil Law And AI Governance System Malfunction Liability In Europe
1. Introduction
AI governance system malfunction liability concerns civil claims arising when an AI system fails because of defective design, faulty data, inadequate supervision, incorrect updates, cybersecurity attacks, model drift, erroneous autonomous decisions, or failures in the governance mechanisms surrounding the system.
Examples include:
an AI medical-governance system incorrectly prioritising patients;
an autonomous industrial AI system issuing unsafe instructions;
an AI financial-control system making erroneous decisions;
an AI employment-governance system unlawfully rejecting candidates;
an AI public-service system incorrectly denying benefits;
an autonomous vehicle governance system failing to react to an emergency;
an AI compliance system incorrectly identifying a person as fraudulent;
a continuously learning system becoming defective after deployment;
a cybersecurity attack manipulating an AI system and causing physical or economic harm.
There is no single European civil-law rule called “AI governance system malfunction liability.” Liability is distributed among:
EU product-liability law;
national contract and tort/delict law;
GDPR;
AI Act;
consumer law;
sector-specific regulation;
fundamental-rights law.
The important development is that the new EU Product Liability Directive expressly treats software, including AI systems, as products, while the AI Act establishes governance, risk-management, human-oversight and other compliance obligations. (EUR-Lex)
2. Meaning of AI Governance System
An AI governance system is broader than the AI model itself.
It includes:
AI model + data + human oversight + monitoring + cybersecurity + update mechanisms + risk controls + organisational procedures
Therefore, a malfunction can occur at several levels.
Model malfunction
The model produces an incorrect output.
Data malfunction
Incorrect or biased data produces an incorrect result.
Governance malfunction
The organisation fails to:
monitor the AI;
investigate known errors;
update the system;
maintain human oversight;
conduct appropriate risk assessments.
Integration malfunction
The AI itself works correctly but is incorrectly integrated into another system.
Cybersecurity malfunction
An external attack manipulates the AI's operation.
Continuous-learning malfunction
The AI changes its behaviour after deployment and develops an unsafe output pattern.
This last category is particularly important because the revised EU Product Liability Directive expressly addresses defects arising through continuous learning where the AI remains under the manufacturer's control. (EUR-Lex)
3. Basic Liability Formula
A useful civil-law formula is:
AI MALFUNCTION → DEFECT/BREACH → CAUSATION → DAMAGE → LIABLE ACTOR → REMEDY
The claimant normally needs to establish some combination of:
unlawful conduct or defect;
damage;
causal connection;
legally recognised basis of liability.
The precise requirements depend upon the applicable liability regime.
4. EU Product Liability Framework
The revised Product Liability Directive (EU) 2024/2853 is particularly important.
Unlike the older framework, the new Directive expressly recognises that:
software, including AI systems, can constitute a product.
It covers software whether supplied:
separately;
through a device;
through a network;
through cloud technology;
through software-as-a-service arrangements. (EUR-Lex)
This is a major development for AI malfunction litigation.
5. No-Fault Product Liability
Product liability generally operates differently from ordinary negligence.
Under the EU product-liability framework, the claimant principally needs to establish:
defect + damage + causal relationship
rather than proving that the manufacturer personally acted negligently.
The revised Directive maintains this basic no-fault structure. (EUR-Lex)
Therefore:
AI manufacturer negligence is not necessarily required for a product-liability claim.
6. What Is an AI Defect?
The revised Product Liability Directive applies the concept of a product being defective when it does not provide the safety that persons are entitled to expect, considering the circumstances.
For AI, relevant circumstances can include:
presentation;
foreseeable use;
instructions;
reasonably foreseeable misuse;
characteristics of the product;
cybersecurity;
updates;
interactions with other systems;
expected lifecycle.
This makes AI governance evidence particularly important.
7. Software Updates
An important modern problem is:
The AI was safe when released but became unsafe after an update.
The revised Directive recognises that manufacturers may remain liable for defects arising from software updates or upgrades under their control. (EUR-Lex)
Example:
AI system V1 → safe
AI update V2 → faulty optimisation
AI begins issuing dangerous instructions
user suffers damage.
The relevant question becomes whether the defect arose from a software change within the manufacturer's control.
8. Continuous-Learning AI
Continuous-learning systems create a particularly difficult legal problem.
Suppose:
AI model initially behaves safely.
Then:
new data → model changes → unsafe behaviour → damage.
The revised EU framework specifically recognises defects arising from continuous learning where the AI remains under the manufacturer's control. (EUR-Lex)
Thus, the traditional concept:
manufacturing defect at the time of sale
is being adapted to:
digital product with an evolving operational lifecycle.
9. Cybersecurity Malfunction
AI systems can malfunction because of:
malicious data injection;
model poisoning;
prompt manipulation;
unauthorised access;
software vulnerabilities;
compromised sensors;
adversarial attacks.
The revised Product Liability Directive expressly recognises the significance of cybersecurity vulnerabilities and failures to provide necessary security updates in determining liability. (EUR-Lex)
However, liability depends on the precise statutory conditions and the party responsible for the relevant security measure.
10. AI Act and Governance
The EU AI Act, Regulation (EU) 2024/1689, establishes a risk-based regulatory structure for AI.
As of September 2026, the AI Act is in force and its general application began on 2 August 2026, although different provisions have different application dates. A 2026 amendment has also postponed the application of some high-risk AI requirements: certain Annex III high-risk obligations apply from 2 December 2027, while Annex I high-risk obligations apply from 2 August 2028. (EUR-Lex)
Therefore, the precise date on which a particular governance obligation applies must be checked against the relevant AI system and provision.
11. AI Governance Duties
For applicable high-risk AI systems, the AI Act establishes requirements concerning areas such as:
risk management;
data governance;
technical documentation;
record keeping;
transparency;
human oversight;
accuracy;
robustness;
cybersecurity;
post-market monitoring.
These requirements are important in civil litigation because a regulatory breach can provide evidence relevant to negligence, defectiveness or contractual breach, although a regulatory violation does not automatically answer every national-law civil-liability question.
12. Human Oversight
A major principle is:
Autonomous operation does not necessarily mean absence of human responsibility.
If an organisation deploys an AI system, it may still have duties concerning:
supervision;
monitoring;
intervention;
shutdown;
correction;
maintenance.
The old argument:
“The AI independently decided”
does not automatically resolve liability.
Indeed, the proposed European AI-liability framework expressly contemplated that an operator should not escape liability merely because the harmful activity was autonomous. (EUR-Lex)
That particular AI Liability Directive proposal should not be confused with a currently applicable general EU AI civil-liability regulation; the operative civil-liability framework remains a combination of national law and instruments such as the revised Product Liability Directive.
13. AI Governance Failure vs AI Product Defect
This distinction is extremely important.
Product defect
The AI software itself is defective.
Example:
Model contains an unsafe algorithm.
Governance failure
The AI might have been technically functional, but the organisation failed to govern it properly.
Example:
Known model error was not investigated or corrected.
Combined failure
Often the two overlap:
defective AI + inadequate monitoring + failure to update + resulting damage.
A claimant may potentially have both product-liability and national fault-based claims, subject to the relevant statutory boundaries.
14. Six Major Malfunction Categories
1. Design malfunction
The architecture itself is unsafe.
2. Data malfunction
Training or operational data is defective.
3. Integration malfunction
AI works incorrectly within another system.
4. Monitoring malfunction
Known errors are not detected.
5. Update malfunction
A software update creates a defect.
6. Autonomous-learning malfunction
The system changes behaviour and becomes unsafe.
15. Case Law
Because AI governance malfunction is a new legal field, there are currently no major European reported judgments that squarely decide the complete issue of “AI governance system malfunction liability.”
The following cases are therefore used as doctrinally relevant authorities, with the limitation clearly identified.
Case 1 — Boston Scientific Medizintechnik, Joined Cases C-503/13 and C-504/13
CJEU, 5 March 2015
Facts
The cases concerned pacemakers and implantable cardioverter-defibrillators that presented a potential risk of failure.
The issue was whether a product could be regarded as defective even where the specific individual device had not been shown to have an actual defect.
Principle
The CJEU held that where products belonging to the same group or production series have a potential defect, an individual product may be classified as defective without separately proving that the particular product contains that defect. (Infocuria)
AI relevance
This is highly useful for AI governance.
Suppose:
AI system Version X has a systemic safety defect.
A claimant may attempt to establish defectiveness through evidence concerning:
the model family;
software version;
known failure rate;
systemic vulnerability.
Important limitation
The case concerns medical devices, not AI.
Its relevance is the principle concerning systemic product defect and safety expectations.
Case 2 — W and Others, C-621/15
CJEU, 21 June 2017
Facts
The case involved an alleged defect in a hepatitis-B vaccine and difficulties proving causation where scientific consensus was absent.
Principle
The CJEU held that, under the Product Liability Directive, serious, specific and consistent evidence could in appropriate circumstances establish defect and causation despite the absence of scientific consensus. (curia)
AI relevance
AI systems are often opaque.
A claimant may not be able to reconstruct:
input → algorithmic processing → output → damage
through source-code analysis alone.
Evidence might instead include:
repeated system failures;
timing;
system logs;
error patterns;
technical reports;
comparable failures.
Principle for AI litigation
Scientific or technical complexity does not necessarily make causation legally impossible.
Case 3 — O'Byrne v Sanofi Pasteur, C-127/04
CJEU, 9 February 2006
Facts
The dispute concerned when a product was considered to have been put into circulation for purposes of product liability.
The product had been supplied by the manufacturer to a wholly owned subsidiary.
Principle
The CJEU interpreted the concept of putting a product into circulation within the Product Liability Directive. (Infocuria)
AI relevance
AI systems create similar questions:
When was the AI placed on the market?
Possible dates include:
initial deployment;
software release;
cloud activation;
major update;
integration into a product.
This becomes especially significant for:
limitation periods;
applicable liability rules;
responsibility for later modifications.
Limitation
O'Byrne concerns traditional product distribution, not AI.
Case 4 — Sanofi Pasteur v M, C-310/13
CJEU, 20 November 2014
This case concerned evidence and proof under the EU Product Liability Directive.
The CJEU considered the relationship between the Directive's burden-of-proof provisions and national evidentiary rules.
AI relevance
AI litigation often involves a severe information imbalance:
manufacturer knows the model → claimant sees only the outcome.
This makes evidentiary rules particularly important.
The case supports the broader proposition that the EU product-liability framework leaves important aspects of proof to national procedural law while setting the boundaries of the Directive.
AI relevance:
Who can prove what, and with what evidence, becomes central to malfunction litigation.
Case 5 — SCHUFA Holding (Scoring), C-634/21
CJEU, 7 December 2023
Facts
The case concerned automated credit scoring under GDPR Article 22.
SCHUFA generated a probability value concerning an individual's ability to meet future payment obligations.
Principle
The CJEU addressed automated individual decision-making where a score generated by automated processing plays a decisive role in a subsequent decision. (Infocuria)
AI governance relevance
The case is highly relevant to governance systems because it demonstrates that an algorithmic score can have legally significant consequences even where:
the algorithm itself does not formally make the final decision.
Lesson
Delegating the final decision to a human does not necessarily remove the legal significance of the automated system.
This is particularly important when human review is merely formal.
Case 6 — Dun & Bradstreet Austria, C-203/22
CJEU, 27 February 2025
Facts
The case concerned automated creditworthiness assessment.
The CJEU examined the data subject's right to meaningful information about the logic involved in automated decision-making.
Principle
The Court recognised a right to an explanation capable of allowing the individual to understand and challenge the automated decision, subject to applicable protections such as trade secrets and third-party rights. (Infocuria)
AI governance relevance
This is extremely important for malfunction litigation.
If an AI system produces:
“Risk Level: Critical”
the affected person may need sufficient information to understand:
what factors produced the result;
whether incorrect data was used;
whether the system operated correctly;
whether the result can be challenged.
Governance principle
Explainability supports accountability.
Case 7 — Google Spain, C-131/12
CJEU, 13 May 2014
Facts
The case concerned Google's processing and presentation of personal information in search results.
Principle
The CJEU recognised important responsibilities for search-engine operators concerning processing of personal data.
AI relevance
Modern AI governance systems similarly:
collect → process → classify → output.
Google Spain demonstrates that the intermediary performing the technological processing can have independent legal responsibilities.
Application
An AI operator cannot necessarily say:
“The algorithm produced the result, so we are not responsible.”
The legal status of the operator and the applicable statutory framework remain important.
Case 8 — Meta Platforms v Bundeskartellamt, C-252/21
CJEU Grand Chamber, 4 July 2023
Area
Personal-data processing, profiling and competition law.
Principle
The CJEU recognised that GDPR issues can be relevant in competition-law proceedings involving a dominant platform, while respecting the institutional roles of data-protection authorities.
AI governance relevance
Large AI systems often combine:
data processing;
profiling;
automated decisions;
market power.
A governance failure can therefore produce multiple legal consequences simultaneously.
Example
AI profiling system unlawfully combines personal data → discriminatory or harmful decision → economic loss.
Potential legal layers may include:
GDPR + competition law + civil liability.
This is an analogical authority, not an AI-malfunction damages case.
16. Case-Law Comparison
| Case | Main principle | AI governance relevance |
|---|---|---|
| Boston Scientific, C-503/13 & C-504/13 | Systemic product defect | System-wide AI malfunction |
| W and Others, C-621/15 | Complex proof of defect/causation | AI opacity and causation |
| O'Byrne, C-127/04 | Putting product into circulation | AI release/update lifecycle |
| Sanofi Pasteur, C-310/13 | Proof under product liability | Technical evidence |
| SCHUFA, C-634/21 | Automated consequential scoring | AI governance and human decisions |
| Dun & Bradstreet, C-203/22 | Meaningful explanation | Explainability/accountability |
| Google Spain, C-131/12 | Technology operator responsibilities | Platform/AI operator responsibility |
| Meta Platforms, C-252/21 | Data processing + platform governance | AI data governance |
17. Causation in AI Malfunction Claims
Causation is one of the hardest issues.
Consider:
AI system malfunctions → incorrect decision → financial loss.
The claimant must connect the malfunction to the damage.
A useful chain is:
Defective AI → erroneous output → human/automated action → damage
But several intervening factors may exist.
For example:
AI recommendation → employee changes decision → market changes → loss.
The court must determine whether the AI defect legally caused the loss under the applicable national rules.
18. AI Black-Box Problem
Traditional negligence litigation often assumes:
human action → observable decision → damage.
AI may instead produce:
enormous dataset → machine-learning model → complex computation → output.
The claimant may not know:
which input mattered;
which model version was used;
why the model changed;
whether an error occurred;
whether the output was statistically unusual.
The European Commission has expressly identified AI opacity, complexity and autonomous behaviour as difficulties for civil-liability proof. (EUR-Lex)
19. Revised Product Liability Directive and Difficult Proof
The revised Product Liability Directive specifically addresses situations where technical or scientific complexity makes proof unusually difficult.
It recognises that complexity can arise from:
machine learning;
complex data;
innovative technology;
difficult causal relationships;
the need to explain an AI system's internal operation.
In specified circumstances, the Directive provides mechanisms easing the evidential burden where the claimant demonstrates the required level of difficulty and other statutory conditions are satisfied. (EUR-Lex)
This is a major development for AI litigation.
20. Damage
Potentially relevant damage includes:
Personal injury
Example:
AI-controlled medical or industrial system causes physical injury.
Property damage
Example:
autonomous AI system damages machinery.
Economic loss
Example:
AI governance failure causes an automated trading loss.
Privacy-related harm
Example:
faulty AI governance exposes personal information.
Reputational harm
Example:
AI incorrectly identifies a person as fraudulent.
Other legally recognised non-material harm
Depending on the applicable legal regime.
The precise recoverability of purely economic or non-material losses differs between legal regimes.
21. Contractual Liability
Where an organisation purchases an AI governance system from a vendor, the contract may contain:
performance obligations;
service levels;
accuracy requirements;
maintenance obligations;
update obligations;
cybersecurity commitments;
audit rights;
indemnities;
limitation-of-liability clauses.
A malfunction can therefore create a contract claim independently of product liability.
Example:
Vendor promises 99.9% system availability and continuous security monitoring.
Instead:
system remains defective for three months.
The customer may have contractual remedies depending on the agreement and applicable national law.
22. Tort/Delict Liability
National civil law can also impose fault-based liability.
Potential failures include:
negligent design;
negligent deployment;
inadequate testing;
failure to monitor;
failure to update;
failure to warn;
inadequate cybersecurity;
negligent human supervision.
A basic formula is:
Duty of care + breach + causation + damage = possible tort/delict liability
The exact test differs among European legal systems.
23. Governance Negligence
A particularly important concept is:
The AI itself may not be defective; the governance surrounding it may be defective.
Example:
AI performs normally 99% of the time.
The provider knows:
1% of outputs can be dangerous.
But it has:
no monitoring;
no escalation procedure;
no human review;
no emergency shutdown.
The resulting claim may focus on:
negligent governance
rather than purely defective software.
24. Failure to Update
AI systems can become unsafe because the environment changes.
Examples:
new cyberattack;
new fraud technique;
new market conditions;
new medical knowledge;
new legal requirements;
new data patterns.
The revised Product Liability Directive recognises that manufacturers may remain responsible for defects arising after placing the product on the market where the defect results from software or related services under their control. (EUR-Lex)
25. AI Governance and Cybersecurity
Suppose hackers manipulate an AI system.
Questions include:
Was the vulnerability reasonably foreseeable?
Was the system adequately secured?
Was a security update available?
Did the provider know about the vulnerability?
Did the operator ignore warnings?
Did the attack break the causal chain?
Was the attack force majeure under the relevant liability regime?
The answer will depend on the applicable statutory and national-law framework.
26. Multiple Responsible Parties
AI systems often involve:
Developer + data provider + cloud provider + deployer + integrator + user.
A malfunction can therefore have multiple causes.
Example:
Developer creates defective model
Data provider supplies defective data
Integrator incorrectly connects model
Deployer fails to supervise.
The revised Product Liability Directive contains rules concerning multiple liable economic operators and joint and several liability in specified situations. (EUR-Lex)
National tort law may separately determine contribution and allocation between wrongdoers.
27. Developer vs Deployer
Developer
Potential issues:
design;
training;
testing;
security;
updates.
Deployer
Potential issues:
selection;
configuration;
monitoring;
human oversight;
operational environment.
Integrator
Potential issues:
connecting AI to other systems;
incorrect implementation;
interface errors.
Therefore, a court should not automatically treat:
“AI provider”
as one legally homogeneous category.
28. Human Error
Human involvement can produce another causal pathway.
Example:
AI generates correct warning → employee ignores it → damage occurs.
The AI may not be defective.
Conversely:
AI generates incorrect warning → employee reasonably relies on it → damage occurs.
The AI system may be central to the causal chain.
Courts therefore need to distinguish:
AI malfunction
from
human misuse
and
reasonable reliance on AI output.
29. Autonomous Behaviour Is Not Automatically a Defence
One of the important concepts developed in the European AI-liability debate is that autonomy should not automatically break the causal chain.
The proposed AI Liability Directive expressly contemplated that an operator should not escape liability simply by arguing that the damage resulted from an autonomous activity, device or process driven by the AI. (EUR-Lex)
Again, this proposal should be distinguished from the binding current national civil-liability regimes.
The principle remains useful conceptually:
Autonomy does not by itself answer the liability question.
30. Force Majeure
Force majeure may become relevant where an extraordinary external event causes the damage.
For example:
completely unforeseeable external cyberattack.
But the availability of a force-majeure defence depends on the applicable legal regime.
A provider generally cannot simply label an ordinary foreseeable AI failure:
“autonomous event”
or
“force majeure.”
The factual cause must be established.
31. Evidence and AI Logs
Important evidence may include:
system logs;
model version;
training-data documentation;
validation reports;
incident reports;
audit records;
risk assessments;
human-intervention logs;
update history;
cybersecurity records;
error rates;
user complaints.
For AI governance disputes, these records may be more important than the final AI output itself.
32. Explainability
Dun & Bradstreet makes explainability particularly important.
An affected person may need information allowing them to understand:
why the system reached its result.
This does not necessarily mean:
complete disclosure of source code.
Instead, the relevant legal question may concern meaningful information about the logic involved, within the limits imposed by other rights and legal protections. (Infocuria)
33. GDPR Interaction
If the AI system processes personal data, GDPR can create additional issues.
Potential problems include:
inaccurate data;
unlawful profiling;
automated decision-making;
failure to provide information;
inadequate security;
excessive data processing;
unlawful retention.
Thus:
AI malfunction + personal data
can generate both:
civil-liability claim + data-protection claim.
34. AI Act Does Not Replace Civil Liability
A very important examination point is:
AI Act compliance and civil liability are not the same thing.
A company may comply with an AI Act requirement and still face a national-law civil claim if another legal duty was breached.
Conversely, an AI Act violation may provide important evidence of unlawful conduct or non-compliance but does not automatically establish every element of a damages claim.
The Product Liability Directive itself preserves the possibility of contractual and non-contractual claims under national law. (EUR-Lex)
35. Regulatory Compliance as Evidence
Suppose an organisation complied with:
risk management;
testing;
monitoring;
cybersecurity;
documentation.
This may be relevant evidence in a national negligence case.
But:
regulatory compliance ≠ automatic immunity.
A court must still apply the relevant civil-liability rules.
Similarly:
regulatory violation ≠ automatic compensation.
The claimant generally must establish the applicable civil-law requirements.
36. Defences
Potential defences include:
1. No defect
The AI operated according to its specifications.
2. No breach of duty
The organisation followed the applicable standard of care.
3. No causation
The damage resulted from another cause.
4. Third-party interference
An external actor manipulated the system.
5. Misuse
The user operated the system contrary to instructions.
6. State-of-the-art defence
In appropriate product-liability circumstances, the defendant may rely on statutory defences concerning the state of scientific and technical knowledge. The revised Directive retains such an exonerating circumstance under specified conditions. (EUR-Lex)
7. Contributory conduct
The claimant's own conduct may affect liability or damages under applicable national law.
37. Remedies
Possible remedies depend on the applicable legal basis.
Compensation
For legally recoverable damage.
Repair/correction
Where appropriate.
Replacement
For defective products or systems.
Injunction
To stop unsafe deployment.
Data correction
Where inaccurate personal data caused the malfunction.
Reassessment
Where an automated decision affected an individual.
Regulatory enforcement
Separate from private damages.
Contractual remedies
Where the malfunction constitutes breach of contract.
38. Special Problem: Economic Loss
Pure economic loss can be particularly complicated.
Example:
AI trading-governance system malfunctions → €5 million trading loss.
The claimant must identify:
contractual relationship;
applicable financial regulation;
negligence;
causation;
foreseeability;
limitation clauses;
applicable national rules.
Product liability should not automatically be assumed to cover every type of pure economic loss; its statutory damage categories must be examined carefully.
39. AI Governance Liability Model
A practical model is:
STAGE 1 — DESIGN
Was the AI safely designed?
↓
STAGE 2 — DATA
Was the data accurate and appropriate?
↓
STAGE 3 — TESTING
Was the system adequately tested?
↓
STAGE 4 — DEPLOYMENT
Was it correctly integrated?
↓
STAGE 5 — MONITORING
Was it continuously monitored?
↓
STAGE 6 — UPDATE
Were necessary updates supplied?
↓
STAGE 7 — HUMAN OVERSIGHT
Could humans intervene?
↓
STAGE 8 — INCIDENT
Did the system malfunction?
↓
STAGE 9 — CAUSATION
Did malfunction cause damage?
↓
STAGE 10 — REMEDY
Who must compensate?
40. Case-Law-Based Legal Principles
The existing authorities produce several useful principles:
Principle 1 — Systemic defect
Boston Scientific
A systemic safety problem can be legally significant even where an individual defect is difficult to demonstrate.
Principle 2 — Complex causation
W and Others
Serious and consistent evidence can matter where scientific/technical proof is difficult.
Principle 3 — Lifecycle responsibility
O'Byrne
The point at which a product enters circulation matters for product liability.
Principle 4 — Automated consequential decisions
SCHUFA
Algorithmic scoring can have independent legal significance.
Principle 5 — Explainability
Dun & Bradstreet
Affected persons can have rights to meaningful information concerning automated decision-making.
Principle 6 — Technological intermediary responsibility
Google Spain
An operator performing technologically mediated processing may itself bear legal responsibilities.
41. Important Distinction: AI Malfunction vs AI Misuse
AI malfunction
AI operates contrary to its intended safe functioning.
AI misuse
User uses the AI contrary to instructions.
AI governance failure
Organisation fails to monitor, control or update the AI.
AI design defect
System is inherently unsafe.
AI data defect
Incorrect data produces unsafe behaviour.
These categories can overlap.
42. Examination Table
| Issue | Legal question |
|---|---|
| Design | Was the AI inherently defective? |
| Data | Was input/training data defective? |
| Testing | Was foreseeable failure adequately tested? |
| Governance | Were risk controls adequate? |
| Human oversight | Could humans intervene effectively? |
| Monitoring | Were failures detected? |
| Updates | Were necessary corrections made? |
| Cybersecurity | Was the system reasonably protected? |
| Autonomy | Does autonomous behaviour affect causation? |
| Evidence | Can claimant establish defect and causation? |
| Damage | What legally recognised harm occurred? |
| Responsibility | Developer, deployer, integrator or another actor? |
| Remedy | Compensation, correction, injunction or other relief? |
43. Current European Position
The European position is moving from a traditional model:
physical product → manufacturing defect → injury
towards a digital model:
software/AI → continuously changing system → governance failure → algorithmic output → damage.
The revised Product Liability Directive explicitly recognises software and AI systems as products and addresses updates, continuous learning, cybersecurity and complex proof. (EUR-Lex)
At the same time, the AI Act supplies an ex ante governance framework, while national civil-law systems continue to determine many questions of negligence, contract, causation and damages.
44. Overall Legal Structure
The easiest way to remember the European system is:
AI ACT
↓
Governance + Risk + Human Oversight + Safety
↓
PRODUCT LIABILITY DIRECTIVE
↓
Defect + Damage + Causation
↓
NATIONAL CIVIL LAW
↓
Negligence + Contract + Delict/Tort + Damages
↓
GDPR
↓
Personal Data + Automated Decisions + Privacy
↓
SECTORAL LAW
↓
Medical + Financial + Employment + Transport + Other sectors
45. Exam-Oriented Conclusion
AI governance system malfunction liability in Europe is an emerging area in which traditional civil-law doctrines are being adapted to autonomous, continuously evolving and software-based systems.
The revised Product Liability Directive is particularly significant because it expressly brings software and AI systems within the concept of products, applies no-fault liability to defective products within its scope, and recognises modern problems such as software updates, continuous learning, cybersecurity and technical complexity. (EUR-Lex)
The case law predates modern generative AI but supplies important principles. Boston Scientific addresses systemic product defects; W and Others addresses difficult proof of defect and causation; O'Byrne addresses the product lifecycle; SCHUFA addresses consequential automated scoring; and Dun & Bradstreet addresses meaningful explanation of automated decisions. (Infocuria)
The central legal idea is therefore:
AI autonomy does not by itself eliminate human, corporate or product liability. The court must identify the defective component or governance failure, establish the legally relevant causal connection, identify the responsible actor and apply the appropriate EU and national liability regime.
Ultra-basic revision formula
AI GOVERNANCE MALFUNCTION = DESIGN + DATA + TESTING + OVERSIGHT + MONITORING + UPDATE + CYBERSECURITY + DEFECT/BREACH + CAUSATION + DAMAGE + REMEDY
One-line exam answer
AI governance system malfunction liability in Europe arises when defective AI design, data, deployment, monitoring, updating, cybersecurity or human governance causes legally recognised harm, with liability potentially arising under the revised EU Product Liability Directive, national contract and tort/delict law, GDPR, the AI Act and applicable sector-specific legislation.

comments