No Robots, Spiders, or Scrapers: Legal and Ethical Regulation of Data Collection Methods in Social Media Terms of Service
This academic paper examines the legal and ethical dimensions of scraping and data collection restrictions in social media terms of service (TOS). Analyzing TOS from 116 social media sites worldwide, the authors find that prohibitions against automated and manual data collection are highly common yet ambiguous, inconsistent, and devoid of context. The paper concludes by arguing that ethical decision-making in social computing research must extend beyond mere compliance with TOS to consider contextual factors such as research purpose and data sensitivity.
Summary and content fields are drawn from the document text and are pending editorial review.
Who issued it
Who it governs
Researchers, academics, and institutional review boards navigating the legal and ethical complexities of collecting digital data from online platforms.
What the document contains
The document covers an empirical analysis of terms of service provisions related to data scraping across 116 social media platforms. It reviews relevant legal doctrines including contract law and anti-hacking statutes, discusses current debates in research ethics, and proposes contextual frameworks for evaluating data collection practices.
The text does not provide a definitive legal or regulatory compliance checklist for scraping, nor does it establish binding institutional or governmental mandates.
- Terms of service provisions prohibiting automated or manual data collection are widespread across social media platforms but frequently ambiguous and inconsistent.
- Legal frameworks surrounding data scraping—such as the Computer Fraud and Abuse Act and contract law—remain unsettled and create significant uncertainty for researchers.
- Most data collection provisions in TOS are entirely agnostic to the purpose of data collection or the specific type of data being accessed.
- Ethical decision-making in digital research should not rely solely on TOS compliance, but must evaluate contextual factors such as user expectations, data sensitivity, and research impact.
· Abstract · Introduction · Unpacking Existing Regulation · Data Collection and Analysis · Findings · Discussion · Conclusion
How it scores
Each score is backed by a quote verified against the document text. Editorial review has not yet confirmed them.
Accountability
0/5Clear responsibility for AI outcomes
screening score · 2026-10-23
Fairness
2/5Non-discrimination and equitable treatment
The lawsuit raises constitutional claims on the grounds that this barrier prevents algorithmic audits and other research designed to uncover discrimination.
Terms of Service in the Law
screening score · 2026-10-23
Human Dignity
0/5Respect for the inherent worth of persons
screening score · 2026-10-23
Human Oversight
0/5Humans remain in control of consequential decisions
screening score · 2026-10-23
Privacy
3/5Protection of personal data and private life
Restricting the type of data that can be collected, and in particular thinking about personal data, shows a particular contextual sensitivity that the majority of provisions do not have.
Data
screening score · 2026-10-23
Transparency
2/5Openness about how AI systems work and are used
A large body of research has confirmed that online terms and conditions such as TOS, EULAs, and privacy policies are highly complex to the point of being unreadable
Terms of Service in Practice
screening score · 2026-10-23
Enforcement
2/5Consequences and compliance mechanisms with real force
Beyond the potential for legal consequences (either civil or criminal), platforms still have the authority to enforce their TOS however they like—for example, by banning a user account from the platform.
Terms of Service in Practice
screening score · 2026-10-23
Impact Assessment
0/5Required assessment of an AI system's risks/impacts before or during use
screening score · 2026-10-23