You may be right that this number does not tell everything. It's hard to tell how many people would change the sort order persistently. But the fact that so few even try once, suggests it's not a big fraction.
We've been following usage of this particular feature in detail. We did not have it in the first versions and people complained a lot. So we were very surprised that when we added it, it was hardly ever used.
There are features that are very important to only few people. We also take such features seriously otherwise the only consequence would be to remove them altogether. But the technical issues I mentioned prevent a quick fix in this case.