inquiring minds (have a right to) know
previously: common sense one, bullshit documents zero
Lots of coverage of the Frasco v. Flo case (more links
at the end). Lead trial attorney Michael Canty claims a Landmark
win. Our clients entrusted their most sensitive information to a
health app, only to have it exploited by one of the world’s most
powerful tech companies. This verdict is a wake-up call to companies
that view consent as a formality and transparency as optional.
But
it could have gone the other way, as other cases have. The Heiting
v. HP Inc. case was ended
by a motion to dismiss. A lot of lawyer time goes into these motions
because they often work. The next case like this will be harder, and
much work remains to be done.
Most of Meta’s arguments were, like the statement
they sent to Suzanne Smalley at The Record, bullshit. The claim that
User privacy is important to Meta, which is why we do not want health
or other sensitive information and why our terms prohibit developers
from sending any
won’t work on anyone who actually has to deal with
the duopoly.
Meta has two sets of rules: the written rules they show to regulators
and the media, and the rules enforced in practice. But Meta lawyers did
make two strong arguments. Time to check the files
from the case and find the key parts from the Meta side.
You can’t prove concrete injury, so you have no standing. Yes, people get ripped off on Facebook constantly, because the way that the ads work on there is designed to facilitate fraud. And yes, a bunch of companies feed information to Meta, without which Meta’s whole system for matching scammers to victims wouldn’t work. But it’s hard to connect a specific input to a specific output.
Plaintiffs’ speculative theories come nowhere near pleading that Analytics Defendants caused them the sort of
concrete, particularizedinjury necessary to establish Article III standing….At most, Plaintiffs posit that they or others could have been targeted with ads theymay find overwhelming or disturbingbased on data Flo supposedly sent to Analytics Defendants. Even if that was a cognizable harm, no Plaintiff alleges that actually happened to them—nor could they. Themere riskof future harm is insufficient.
Plaintiffs are short on data for a reason. Meta has a Hydra of data stores and machine learning (ML) systems. Even for internal experts, querying the system to try to figure out which incoming data resulted in which ad targeting decisions is difficult. From the outside, it is hard for a plaintiff’s expert to come up with enough info about which data collection resulted in which harms. The concrete injury argument didn’t work for Meta this time, but it has worked in other situations and with other judges.
We’re just the recipient of data. This is different
from the bullshit we’re shocked to discover Flo doing what we
incentivized them to do
defense. There is a legit argument here. If
you leave your diary at my house and I call up some company and read it
into their voicemail, then there is no way that company should be
responsible for the privacy violation.
Plaintiffs’ claims against Analytics Defendants fail for independent, claim-specific reasons. Many of the deficiencies flow from the basic fact that the law does not impose liability on a party receiving data intentionally sent to them—to do so would create a strict liability framework with due process concerns because a receiving party cannot control what a transmitting party sends. For instance, Plaintiffs’ UCL and aiding and abetting claims (Counts 9, 10, & 11) reflect an impermissible attempt to impose vicarious liability on Analytics Defendants for practices not under Analytics Defendants’
unbridled control.Similarly, Plaintiffs’ wiretapping and eavesdropping claims (Claims 12 & 13) fail because Plaintiffs do not allege any Analytics Defendant intercepted their data, but allege that Flo first created and subsequentlytransmittedandsentFlo App data to them that may have revealed Plaintiffs’ personally identifiable health information. Nor can it possibly be computer hacking (Claim 14) to receive information purposefully sent by a third party.
Following the New York State Department of Financial Services report, Meta is making an effort to filter out sensitive data. Next time, even if the plaintiff’s expert can come up with a detailed log of information passed to Meta, no individual log entry will show a sensitive data point. And the argument that Meta is just receiving ToS-compliant data from the app will stand a better chance of working. But let’s consider what is already probably happening behind the scenes, now that Meta has started to do the work to show that they are rejecting obvious sensitive data.
Meta actually starts filtering out some or all sensitive personal data. (They won’t mind because they get it back in step 3.)
Companies still get rewarded in some way for making Meta aware of sensitive personal data, but they have to figure out a back-channel way to send it. For example, what ordinary-looking personal activities change depending on the user’s menstrual cycle? Instead of sending the menstrual cycle directly, send enough other activities that an ML system will be able to infer where the user is on the cycle.
An ML system at Meta reconstructs the sensitive personal data from the data sent in step 2, as an
inference.
The end result is roughly the same as sending the sensitive personal information directly, but now it’s buried in an internal ML system at Meta, and is never sent in a way that Wall Street Journal reporters can peek at using a proxy. Instead of incentivizing the sending of sensitive data (which means trouble) Meta can reconstruct sensitive data with ML (still trouble, but try proving it) and incentivize the sending of the needed volumes of less sensitive data.
State privacy laws can help
Both the standing argument and the recipient argument are bad news for journalists and lawyers, but exactly the kind of thing that can and should be addressed in state privacy laws, and made a priority by regulators. Thinking big picture for a minute, people have three teams to protect them from privacy harms: Legislators and regulators, lawyers in private practice, and journalists and researchers. Each of the three is vulnerable to spinning off into a failure spiral without the other two.
Regulators: Without the common sense provided by
jurors and news site audiences, regulators can get snarled up with
compliance
paperwork without motivating meaningful changes in
business practices or reducing harms to people.
Journalists and researchers: Without the prospect of regulatory or legal action, journalists and researchers are trapped on the doom loop of (1) find something heinous going on, get some clicks (2) the surveillance company uses the journalist’s or researcher’s work as free QA, changes something to make the problem less obvious (3) surveillance company continues to hog the ad revenue and work the political system so there are fewer journalists and less research funding next time (4) repeat as long as you can
Lawyers: Without the information that could be provided by the other two, lawyers risk getting stuck doing small-time cases over stupid stuff like JavaScript mistakes that can be spotted in browser dev tools, instead of pursuing the bigger, transformative cases. These cases bring in some money in the short term, but in the medium term they provide talking points for lobbyists who are advocating for anti-privacy legislation.
How the next cases will be harder
After Frasco v. Flo, the surveillance business will do what it can to make the next case harder. Expect Meta to make continued investments in ML, to:
Put as many layers of inscrutable processing as possible between a data transfer and the resulting harms.
Apply first, filters to remove sensitive data from places where it can be seen passing from company to company, and second, ML to reconstruct the sensitive data in the form of inferences.
Both of these are hella resource-intensive. But as far as I can tell, the best countermeasure that we have is not. The common tool that can help address both is the humble right to know (RtK). California Attorney General Rob Bonta wrote, in a 2022 Opinion of the Attorney General (PDF),
The plain language of the [California Consumer Privacy Act (CCPA)], as well as the legislative history, persuade us that the CCPA purposefully gives consumers a right to receive inferences, regardless of whether the inferences were generated internally by the responding business or obtained by the responding business from another source.
The Right to Know—written into legislation and (if all goes well) enforced by the Attorney General or some other public official—solves a problem that journalists and lawyers can’t solve on their own. Right now, RtKs are hard to do, have limited effectiveness, and are under-used. But an effective RtK process, backed up by regulator attention, can require the disclosure of inferences that were used to perpetrate harms. Right now, your propensities to fall for different varieties of scams are some kind of data points in some kind of data store at Meta. Those data points are actively being processed when scammers bid in an internal auction for the ad impressions you see. Technically, according to the law, Meta is required to disclose those inferences. Stronger, more informative RtKs won’t give lawyers a case already gift-wrapped, but they give researchers and data journalists some strings to pull on. Sign up the recipients of scam ads as research volunteers, look at the inferences stored about them, look at who passed data about them, do some stats. The resulting news stories and research reports will help privacy lawyers focus on higher-impact cases.
For regulators, one lesson of Frasco v. Flo will be:
don’t let anybody give an RtK sender any grief. If a
company is obviously using inferences but not disclosing, they need a
lot more attention because that’s a good indicator that concrete harms
are happening. Privacy lawyers aren’t full-stack
crime fighters—they will get a lot further starting from reports
based on RtK data. RtK processes need to be not so maze-like that they
make research and data journalism harder. Enforce the regulations on dark
patterns
and deceptive UI—companies that are using them are
probably doing other crimes, too. maybe there should
be something like an Al
Capone theory for sneaky UIs. A regulator can’t expect a
company to make some kind of breakthrough in ML in response to an RtK.
However, money is already being made from important but undisclosed
inferences such as propensity
to become a big-time sports bettor. In the event that an inference
is actually used to perpetrate some harm
to a user, it needs to be disclosed (even if the maintainer of the ML
system has to do some coding) and the AG or regulator needs to be on the
case if it’s not.
From the legislative point of view, a powerful RtK section in a state law, and funding for a regulator to enforce it, will have a lot more impact than other material that only comes into play when a company loses the privacy compliance reverse lottery where the prize is AG attention. Fighing for private right of action is important, but possibly more important is fighting for RtKs so good that they disclose enough concrete harms that the private right of action is a nice-to-have, an extra section in a case that’s already strong.
More news from the case
Meta
violated privacy law, jury says in menstrual data fight by Margaret
Attridge on Courthouse News Service. Jurors were given three
questions—and on each one, they ruled against Meta. They said that yes,
Meta had intentionally eavesdropped and that yes, users could have
reasonably expected that their sensitive menstrual information was not
being shared. Finally, the jurors ruled that no, Meta did not have
consent for its actions.
Meta
used Flo menstruation app data to sell ads, jury finds by Iain
Thomson on The Register. [I]n 2019, the Wall Street
Journal reported Flo was sharing health events with Meta. The discovery
prompted the Federal Trade Commission to investigate the matter in 2020,
and it issued a formal complaint [PDF] in 2021. The complaint shows
Meta, Fabric (formerly Twitter’s SDK but later folded into Google’s
Firebase), and analytics biz Flurry had been using Flo data since 2016,
and Google and marketing concern AppsFlyer since 2018.
(All the
other companies settled.)
Meta
Violated California Wiretap Law, Jury Finds by Wendy Davis at
MediaPost. The verdict—which appears to mark the first time a jury
found Meta violated users’ privacy—stems from allegations that the
company gathered ad-targeting data from an app via a software
development kit. The jury specifically found that Flo users proved Meta
intentionally eavesdropped on and/or recorded their
conversations,
in violation of a California wiretap law prohibiting
anyone from recording electronic communications without all parties’
consent.
Meta
eavesdropped on period-tracker app’s users, SF jury rules Along
with the eavesdropping decision, the group determined that Flo’s users
had a reasonable expectation they weren’t being overheard or recorded,
as well as ruling that Meta didn’t have consent to eavesdrop or record.
The unanimous verdict was that the massive company violated the
California Invasion of Privacy Act.
Jury
finds Meta broke wiretap law by collecting data from period-tracker
app by Jon Brodkin at Ars Technica. Details on the plaintiffs’
settlements with Flo Health and Google haven’t been released yet. Those
two settlements were announced shortly before the trial. Flurry settled
late last year, agreeing to pay $3.5 million to pay claims from Flo app
users and other costs, but the settlement is still pending court
approval.
Bonus links
Is
It True Nobody Reads the T&Cs? by Lucy Purdon. Article 12 of
GDPR says that communications to individuals about their data must be
presented in a “concise, transparent, intelligible and easily accessible
form, using clear and plain language, in particular for any information
addressed specifically to a child”. Expectations are further outlined by
the UK’s Information Commissioner’s Office (ICO) Age Appropriate Design
Code, likely to be updated in light of increased protection for children
under the The Data (Use and Access Act) 2025 which came into force on
June 19th.
(There is almost nothing in common between today’s
surveillance industry consent
software and actual consent.
In
this age of technofeudalism every writer who covers technology -
especially resistance to Big Tech - should disclose their tech stack.
Here’s mine by Elena Rossini. I believe that the platforms and
apps we use send an important message about our values. Never in a
million years would I ever use Substack or anything by Meta. It’s too
easy to say
I need to stay because this platform is free and it gives
me reach.