New post for clarity's sake. Here's some more links, that previous article kinda oversimplified things I think.
Here's the official blurb about the system from the League website.
http://na.leagueoflegends.com/en/news/g ... ds-testingHere's Lyte talking about the player reform system on Reddit:
http://www.reddit.com/r/leagueoflegends ... ng/crfu61pAnd here's the rundown of salient points Lyte made on Reddit from
Surrender at 20, so you don't have to parse your way through Reddit comments:
Quote:
In response to concerns over this automatic system, Lyte explained:
"I think there's a perception issue with "automatic" systems. For example, when we think about really high security stuff like credit cards, they use a lot of automatic systems but we don't really "think" about accuracy. In some fields of sciences, a 1% error rate is considered exceptional, even if it's in a higher risk field like medicine.
At Riot, we want to make sure players never have to worry about punishment systems if they are neutral or positive. So, any system that we launch needs to have a 0.1% error rate or lower or we'll turn the system off. In first beta test of the new reform system, we were having Player Support teams review thousands of cases and we found that generally there was 1 error in every 6000 cases. In the case that a player did receive a false penalty, the e-mail has instructions and links to contact Player Support."
He continued, replying to concerns about "false punishments".
"I mentioned this in another response, but in our initial test where we hand-reviewed thousands of cases, we saw an error rate of about 1 in 6000 cases.
Given League's scale and massive playerbase, this is still a large number of players affected, and we have systems and teams in place to fix this as soon as it's detected."
As for that hand review process, Lyte elaborated:
"We already did a round of testing where Player Support teams and Player Behavior teams all banded together and hand-reviewed every single case.
Moving forward, we'll use a technique called "random sampling," where we'll random pull a bunch of cases the system and hand-review those which will give us a representation of how accurate the system is doing without reviewing every single case.
With random sampling, we can purposely target more serious punishments and sample them more often because they are a higher impact if they are mistakes."
When asked if there is a difference between a "false" (bad-faith) report and a "not-punish-worthy (good-faith) report as far as the system is concerned, Lyte noted:
"Yes, the system "validates" every report, and false reports are ignored. If the report is generally correct, but the system just doesn't believe the behavior is worthy of a punishment, the reports will still "stick," and could affect the next potential check of the player."
When asked why they chose a "machine learning" engine for this new system, Lyte explained:
"The reason we like a machine learning engine's approach is because it is very difficult to work around. Because every player's report and honor teaches the system about emerging changes in language, the system can "keep up" with new phrases and trends faster than a human team would be able to.
In the future when players can read random chat logs and vote in the Tribunal again on whether behaviors are negative, neutral or positive, these will also teach the system more about behaviors on a continuous basis."
When asked if the system will note any sort of profanity if you end up reported, Lyte noted:
"The system isn't necessarily out to get rid of profanity. If you say things like, "Fuck, missed that skillshot" you will generally be fine. If you say, "Fuck you, you missed that skillshot" you might end up punished because that's targeting someone."
He continued:
"We've mentioned this before, but for 95% of players in the game, they'll never be exposed to a penalty in their lifetime playing League.
If you are neutral or positive, you should bodaciously have no fear of any system."