Comment by atemerev

The solution is easy though (it was adopted long time ago by Everything2 project): count the actual clicks on backlinks, and sort them by their usage frequency. Maybe even automatically forget the links that were never used for some time, just like human brain does.