cancel
Showing results for 
Search instead for 
Did you mean: 

We’re Improving Leaderboard Accuracy ✅

mal
Strava
Strava

Good news! We’re updating our algorithms to make leaderboards more credible, and taking steps to proactively prevent suspicious efforts from appearing on leaderboards – so you can trust that the results you see are accurate. We're withholding from leaderboards any activities that appear incorrectly labeled (e.g. a bike ride getting uploaded as a run) or have faulty GPS data.

With these and other ongoing changes, we can better ensure your efforts will get the ranking they deserve and you can trust that the CR, KOM or QOM (plus all the other times on the leaderboard) are the real deal. These changes will be for all activities moving forward – we can’t yet capture past activities. And of course, you can still report an activity if you think there’s one the algorithm missed. Learn more about that here.

This is a big undertaking – we saw around 26,000 1-mile running splits that would have been faster than the world record last week! – and the work will be ongoing. Here’s how we’re committing to cleaning up leaderboards right now:

The Details 📝

✔️ There’s a new threshold for flagging: Activities with too much erroneous data will be automatically flagged – which means all segment efforts from those activities will be withheld from leaderboards.
✔️ We’re doubling down on catching bike rides (or downhill ski runs, car rides, etc.) marked as runs with new run-specific parameters that will flag activities based on their distance and pace data.

Malire
STRAVA | Product Marketing

25 REPLIES 25

Jane
Moderator Moderator
Moderator

Hello,

Thanks to everyone who recently commented on this topic and provided examples of invalid activities.   We hear you.  Segment leaderboards are an important part of Strava and we understand your passion around segment leaderboard accuracy.  

We don't have any updates to share right now, but your input and examples have been passed on to the Team.  In the meantime, if you see invalid times on segments, the first step is to use the activity flag tool. If the Athlete doesn't correct their behavior after getting their activities flagged, you have the option to report that Athlete to Strava Support so we can follow up.


Jane (she/her)
STRAVA | Community Hub Team

Alex_Michel
Pico de Orizaba

@mal  @Soren : could you please update us as to what specifically has been done since June 2023 wrt the following statement:

"We are continually evaluating and improving the algorithm and I will pass this along to our team."

ARoger
Pico de Orizaba

An example of an activity from July that was partly done on a car, but the new system didn't catch it:

https://www.strava.com/activities/9408292731/analysis

Check the analysis for the wattage. For 30km or so, Watts were mostly up to 1000W, but then it went down to 100-150. An absurd discrepance like that should automatically flag the activity. 

But yet here we are...

ARoger
Pico de Orizaba

There's still way a lot of work to be done. Since this was posted, I have seen loads of people in leaderboards with totally unfeasible PRs. The AI should take the whole ride into account.

For example (it is real), a person did a 54km ride in 4h15, meaning that her average speed was 12,8 km/h. Then in a 0,76km 1.9% slope, she managed to get an average of 31,7 km/h. It's obvious that there's an error here. Her whole activity should be discarded for the public leaderboard.

Another thing to get into account is if the person used a heart monitor. Lots of these fake leaderboards entries are done by people without a heart monitor, something that (I think) most serious users do use.


@mal wrote:

✔️We’re doubling down on catching bike rides (or downhill ski runs, car rides, etc.) marked as runs with new run-specific parameters that will flag activities based on their distance and pace data.


What about car and motorbike rides that are marked as bike rides? I catch tons of these.

The lack of response from Strava and the continued presence of impossible activities at the top of leaderboards is very telling. Strava is clearly putting it's head in the sand. But hey, at least you can DM someone now!

susuncorda
Mt. Kenya

Great news.

Segments are a main motivation for many many riders as you know.

(We) The community helps by marking or tagging, but facilitating cleanup with tools that detect easy-to-identify cases is something that users appreciate.

Now all that remains is to fix the inequality of fighting in the classifications if you are an athlete riding alone VS a riders group (amateur or even a professional race) and I have contributed an idea about that in a separate topic.

Except their tools are not working as intended. Case in point:
https://www.strava.com/segments/18212621

 

RonHuizenga
Shkhara

It's nice to see this.  There are a lot of leaderboard items that don't even appear feasible.  case in point, the July Cycling Challenge - the leader has over 11,000 km in 25 days.  That's 450 km/day, every single day.  The Tour de France athletes are about 170 km/day an their active days.  There's a lot of work to analyze data, but it should be reasonably straight forward to add some validation by activity type for maximum feasible limits per time period to trap and exclude the outliers.  -  or is that out liars? 😉  

Ready, Get Set, Go!

Welcome to the Community - here is your guide to help you get started!


Know how to use Community


Understand Community Settings