How we score streaming services
We have developed objective criteria to evaluate streaming services, powered by over a decade of experience closely following them. Here is how it works.
Why we built it
It's tough to trust online reviews in the age of affiliate payouts and ad budgets. We wanted to create a fully transparent system that ranks services based only on the things that matter:
- Content quality (does it have a good catalog?)
- Value for money (is that catalog priced fairly?)
- Apps and device experience (how easily can you access said catalog)
- Streaming quality (how well you can watch said catalog)
- Customization and add-ons (for live TV, can you build the package you want)
The five criteria
Each is scored 0 to 10 on its own, then combined. Here is what earns a 0 and what earns a 10.
Content quality
50% of the score (40% for live TV packages)The two types of service are not measurable on the same axis, so they are measured differently.
Live TV is scored on how many of the 20 most-watched US cable networks it carries, checked against the channel lineup we keep for every service: Fox News, MS NOW, HGTV, ESPN, CNN, Hallmark Channel, TBS, USA Network, History, TLC, Food Network, Discovery, Game Show Network, TNT, INSP, TV Land, Investigation Discovery, A&E, AMC and Bravo. Carry all 20 and you score 10, but the scale bends: the first channels a service adds count for more than the last few, so ten of the 20 already scores 7.1 and five scores 5. That includes free services with a live guide: hundreds of channels count for nothing here if none of them are the ones people actually watch.
On-demand is scored on how many titles from the AGMTW recommended list it carries. That is our own curation, built over a decade, so it measures the thing readers actually come here for: is there anything on it worth watching. The count is log-scaled, so going from 50 to 100 good films counts for more than going from 900 to 950.
Source: the channel lineup we keep for every service; ustvdb.com network ratings for the 20 networks; the AGMTW catalog.
Value for money
20% of the score (16% for live TV packages)Price against the cheapest service of the same kind, then weighed against what the service actually carries.
A $90 cable replacement and a $9 channel package are not offering the same thing, so ranking them together says nothing. Every service sits in a basket defined by its type and its price band, and its price is scored against the floor of that basket, on a curve: twice the cheapest price scores 7.1, not 5, since paying more for a better service isn't a crime. But cheap is only good value if there is something to watch, so that price score is then scaled by the content score: a service with full content keeps all of it, one with nothing worth watching keeps half. Being free, on its own, no longer earns a perfect score.
Source: the advertised monthly price of the plan we list; the content score above.
Apps and devices
20% of the score (16% for live TV packages)Half how good the app is, half how many screens it actually runs on.
A service can have a beautiful app nobody can install, or run everywhere and be miserable to use. Scoring both catches both. The device list is Roku, Fire TV, Apple TV, Chromecast, Samsung, LG, Vizio, Xbox, PlayStation, iPhone, Android and the web browser.
Source: live iOS App Store and Google Play ratings; the platform's own supported-devices page.
Streaming quality
10% of the score (8% for live TV packages)The picture and sound you actually get, on the plan whose price we list.
Usually the base plan. Plenty of services advertise 4K that only exists on a tier costing twice as much, and we score the tier a reader would actually land on.
Source: the platform's published specifications.
Customization and add-ons
20% of the score, live TV packages onlyHow far you can build the package you want, instead of paying for one fixed lineup.
We count the genre add-on packs a live TV package sells at $15 a month or less: sports, news, kids, Spanish-language, lifestyle and so on. Single premium networks sold on their own don't count, since nearly every service resells the same ones. The scale bends like the content scale: the first few packs count for more than the last. On-demand, free and single-network services have no package to build on, so they skip this criterion and keep the four-criteria weights.
Source: the platform's own add-on and package pages.
How they add up
The overall score is a weighted average, not a flat one. What you can actually watch decides half of it, because a cheap service missing everything you watch isn't cheap at all.
Live TV packages:
The baskets
Value for money only compares like with like. These are the groups, and how many services sit in each. Every service in every basket is listed at the bottom of this page.
DIRECTV is ranked against Fubo, YouTube TV and Hulu with Live TV. Frndly TV is ranked against Philo and Sling Essentials. Neither is ever ranked against the other.
What the spread looks like
If a scoring system hands out 90s to everything it is not measuring anything. Here is how all 186 services actually fall.
Where that lands today
The ten highest-scoring standalone services right now. Bundles and rent-or-buy stores are left out, the same as on the hub. The four bars under each name are content, value, apps and picture, in that order.
Every service in every basket
All 186 scored services, grouped by the basket their value score is measured in. Within each basket they are ordered by overall score.
Go and use it
Every score is live on the hub, where you can filter by channel, price, device and any of the five criteria.
Find a streaming service →