Comment by cperciva
12 years ago
Someone who has a pending comment will have to wait till it goes live to post another. We're hoping that good comments will get endorsed so quickly that there won't be a noticeable delay.
Is there some timeout? If not, commenting on a several-day-old thread will guarantee that you can never post another comment, since once threads drop off the front page it's not likely that many 1000+ karma users will even see those comments, never mind endorse them.
Hmm, trust cperciva to find the thing I'd overlooked.
I'll add a pending page that collects pending comments. Maybe that will solve the problem.
That might work... but only if people actually read that page. Given how few people look at /newest (as estimated by the fraction of votes which are cast before submissions hit the frontpage) I'm not optimistic.
How about only placing comments into the "pending" purgatory if the submission they're attached to has received more than X comments in the past Y minutes? I assume it's the chatty discussions which you're concerned about cooling down, so this would handle the problem case while avoiding the side effect on quiet/abandoned threads.
I think I like this idea quite a bit. I don't know how many users there are with >1000 karma, but will they be motivated to keep endorsing everyone else's pending posts? Sometimes good discussions do happen on quieter threads, or way down the list that the 1000+ users might not see.
Well, I guess it really comes down to just how much (proper) endorsing ends up happening. One thing I like about HN is that it's open and fast to use. Having a pending mode on everyone's comments affects not only the troll-users, but many of the normal ones too who aren't abusing the system ><.
14 replies →
> How about only placing comments into the "pending" purgatory if the submission they're attached to has received more than X comments in the past Y minutes?
Fluff will pass through.
Another option would be to enable the pending machine on big stories for the time they are on the home page, then auto-validate everything (but mark the unendorsed comments as such).
It would be nice if users with a lower karma could validate the replies to their own comments, once they have been validated.
1 reply →
Let's see how much of a problem there is first. I wanted to start with the simplest possible thing. If it breaks in some cases I'll add stuff to fix those.
16 replies →
This was all the code it took:
In this project I've really benefited from having kept the code tight.
Forgive me for asking what's probably a simple question: what's HN coded in? That's pretty clearly a flavor of Lisp... what's the square bracket predicate syntax?
3 replies →
Another option would be to allow the withdrawal of pending comments by the submitting user. Reply -> you already have a pending comment (with a link to the explanation of the system). Would you like to withdraw your comment X in thread Y and post this comment? -> Y/N.
A good idea but race conditions could still cause both comments to be posted. Maybe if we decide the user can't do that reliably, we cod just let that case slide.
1 reply →
The fact that that consequence was literally what I immediately thought of when I read this makes me believe that you have not thought this issue through deeply enough. You say
>the thing I'd overlooked
but this is a drastic overhaul you are proposing, and I believe you have overlooked many other things too.
Let me give you some examples of other consequences: The amount of activity on HN varies with time of day. This is a problem, because on low activity hours, there will be fewer approvers (presumably, every approver has a particular taste, so the more people around, the higher the likelihood someone with compatible taste will find and approve your comment) around. This will mean that the few people that are there during the off-hours will have reduced posting speed. Since the site is more American than European, this will favor american posts over european. Furthermore it will be risky to respond to people down low on the page. Longer post delay! This will (further) encourage threadjacking people up high on the page. One potential consequence is that you will have to be attention grabbing. Probability of approval=eyeballs*individual probability.
What about reserving the pending system for stories on the front page where you typically get the bulk of low-quality comments? A user commenting on a 2-day-old front-paged thread is either contributing meaningfully or feeding a flamewar, so by automatically endorsing all comments on stories that have fallen off the front page, you allow the former to continue a meaningful discussion unhindered and you give the latter no incentive to continue a meaningless argument (no one is seeing it).
Also, from what I've noticed, the Ask HN posts tend to receive comments of higher quality since the questions/submissions there aren't as sensationalist or polarizing, yet that particular section of the site receives only a fraction of the attention that the front page gets, so implementing the pending system there might unnecessarily stifle discourse.
I had a bad feeling just reading the initial post, before thinking about any specific drawbacks. But this? If you failed to notice that your system would result in many users being arbitrarily and permanently banned, what else have you missed that no one else has pointed out yet?
Personally, I wouldn't read a "pending comments" page, because I come to HN to read and discuss stories that interest me, not to browse piles of random, context-free comments. I suspect that most users will feel the same, so it won't help much.
This entire thing is a bad idea, and the current state of Hacker News comments is nowhere near bad enough to warrant such drastic measures.
I think it'd be smart to only have this pending workflow during the period where the signal to noise ratio can be affected the most: the first N hours after a post first hits the front page.
After that, either nobody is posting anymore or the relative impact of a snide comment is quite low (in terms of viewership and also relative to body of the thread.) Usually after a day or two people are just ping-ponging in their own private threads and there isn't much need for the endorsement bottleneck.
The place where this seems crucial is in determining which comments end up being the upvoted root comments for the main thread. These comments are upvoted early on and ultimately end up forming the shape of discussion from that point forward, so it's a good idea to ensure they aren't flamebait.
Also worth mentioning that 'patio11 posts late at night (our time; he's in Japan) in little bursts. But he's not high-volume, so maybe that doesn't matter.
I'm looking forward to seeing how this plays out.
I wonder how this change will play out with respect to the 24 hour nature of the site. It really has a different flavor depending on when/where you are in the world. In general I tend to think of HN as having four flavors: East-Asian, European, East coast (NYC) and West coast (SF).
I tend to be awake at odd hours, and over a 24 period, it's quite interesting to watch.
Considering Patrick's tendency for amassing huge amounts of karma (not a dis), even on older threads, I'd be surprised if that poses any issue whatsoever.
6 replies →
How about purging pending comments after a certain time (say 24 hours)? If they haven't been endorsed by that time, they will most likely never be endorsed. And even if they would be, nobody would read them anymore.
That is exactly what happens.
15 replies →
Ok, so those of us with 1k+ karma will have the option of creating an new account for posting, leaving the old one to just be used for endorsing our pending comments...
Now, since we're great guys and girls (having reached 1k karma) we wouldn't do that of course.
I still think slashdot has the least bad large-scale, distributed moderating system I'm aware of -- I think maybe being able to thread and filter on votes/mods is a better approach. Still, it'll be interesting to see how this thing plays out.
I guess that would be caught by the vote ring detector or similar.
If the pending comments feature is an answer to a problem, it was so poorly thought out and brash that it wouldn't be approved under its own system.
Another idea would be: tie the number of outstanding comments allowed to the user's karma.
For those of us in non-US timezones, it would be nice to be able to post a few comments before having to wait while the site isn't getting much traffic. I would say something like 500 karma = 1 extra comment you can make before getting the previous ones endorsed.
Related to this: are there any hourly visit stats available? I currently work nights in the GMT+1 timezone, so I'll probably end up all over this scale (depending if I'm posting from work, or during the day when off...).
This could be some additional meta-info to add to the 'post stories on Mondays'-"rule"...
No, that does not solve the problem. It still means that if a user ever posts a single comment that doesn't deserve or doesn't get endorsement for some reason, then they can never comment again.
I don't think this idea has been thought through enough to deploy.
Furthermore, how about auto-accepting pending comments after 1 day? And maybe, not having the pending state for threads which are more than 1 day old?
The above will allow people to submit comments even when the thread has lost its popularity.
I think this goes against the ideas the curators of HN have for HN. For the simple goal of furthering (meaningful) conversation, I think dropping comments would be better.
On the other hand, I think it'll drop the number of really good comments -- those where commenters go out and lookup a few (possibly obscure, but very interesting) references. Doing that kind of work, just to have the text be deleted with hardly anyone seeing it doesn't seem worth it.
Which brings us back to the question of "What should HN be, for whom -- and how do we achieve that?".
I'll admit I'm slightly alarmed that "you can't ever post another comment until other people do X" didn't set off some klaxons for you.
For another thing you might or might not have overlooked: doesn't a person endorse a comment for the same reasons she would upvote it? If so, upvoting would endorse it, and you don't need a dedicated 'endorse' button. The pending comment can stand out with a [pending] tag or a different shade. That would make endorsing weave itself more naturally into users' current habits. On the plus side, if a 1k+ karma user is into the habit of upvoting fluff comments it will soon bite them when they do that mindlessly to a pending comment. Pavlov is a good teacher.
It would also be good for a person commenting (especially at toplevel) to be able to see replies, endorsed or not. There are plenty of useful comments that might not really merit endorsement or visibility by all but are a widely used - various small technical corrections, requests to get in contact, etc.
What about when a permanently-pending comment is deleted? Does that satisfy the conditional? Relatedly, can there be a case to ensure that pending comments can always be deleted?
A site I used to work for had a pre-moderation system for pictures posted on the site that worked like this, to the best of my memory: There was a moderation queue and various volunteers (here it could be the >1000 karma people, I guess) went through it and gave their vote. A picture had to reach all positive 3 to go live or positive six to go live if there were any negative votes. Moderators were awarded points based on how many of their votes matched the consensus. This encouraged them to keep doing it, even though it's kind of boring. Here that could be karma bonuses.
If you really want to make sure that every post gets voted on you may need to do something like that to incentivize endorsements.
> Moderators were awarded points based on how many of their votes matched the consensus.
That's cool because I can imagine for a picture site you want all pictures to gravitate around the consensus, a strong self-selecting group-think can be very desirable.
But for HN ... well at least the people who end up sticking around will surely love it ...
1 reply →
How about making the pending comments scoped to a thread? That way, no one can get locked out of commenting completely, but they can't make a bunch of bad comments on a certain thread if they violated the rules once.
So if I write a comment that people don't want to endorse – let's suppose it's actually bad – then it's pending forever and I can never post again?
PG mentioned somewhere else that there's a 24 hour timer, after which point the pending comment is deleted -- and one can post again. It does sound to me as a rather steep penalty for wandering off the beaten path. One would be free to self-censor of course, which I suppose is the intention.
We'll see how it goes, but it does sound like it'll likely work against HN being somewhat heterogeneous, and (even more) towards group-think.
1 reply →
> Hmm, trust cperciva to find the thing I'd overlooked.
I don't understand. The whole point of not being able to post until your previous post is endorsed--which is strictly separate and independent feature from invisible-until-endorsed--would be that people stop and reconsider "hm is this really the best I can do" because if it isn't they'll be muted ... indefinitely?
Or can you delete your own pending comment if it seems that no one is going to endorse it for you?
If not, that's going to become a huge chilling effect on unique thoughts and ideas that may either be controversial, or simply unpopular. Quite a stifling gamble. And even if you do get to remove that post from pending-limbo so you're at least not muted indefinitely, that still means the unique idea hasn't been shared, and in fact has been self-censored.
And will controversial ideas be endorsed? Because you said that endorsing the "wrong" kinds of comments will get your endorsing-rights revoked. I'm assuming, like all moderator-actions on HN, the user will get absolutely no notice or feedback about this.
Endorsing slightly controversial comments will be like feeling your way in the dark, err on the side of caution, better to just endorse comments that align with the perceived HN-groupthink (which may very soon become much realer, with this new system).
This is not a question of "but we have to be better than that", because these processes run on the aggregate of a very large group of people. Very large groups of people are vanishingly unlikely to "be better than that", no matter how clever, smart, talented or well-intentioned their individuals are.
So that will happen.
And that's just the collateral effects regarding content of posts (I say collateral because they are at best orthogonal to the quality of discussion on HN).
Like cperciva points out, if people are going to hesitate posting if they are unsure they'll be stuck in pending-limbo for how long or indefinitely, they are going to adjust their behaviour with regards to all factors that may influence how long it takes before a post gets sufficiently endorsed.
Which includes very irrelevant ones, like whether it's a quiet or new thread. Or, you know, making contact, silly stuff like "drop me a mail at <username>@gmail" between two sub-kilokarma users in a not-very-busy thread, risk locking their commenting privileges for quite a while.
Sorry if I dare to say so, but overlooking all these things, it seems like you just considered only the positive consequences of this big change, and none of the possible negative ones?
Then there's the final big negative one, which I think lacks a bit of self-reflection in order to overlook: HN already is quite the echo-chamber. These new rules are going to make that much worse. If, after a month or two of these new endorsing+feeling-in-the-dark+best-safest-to-conform rules do not make me feel like the quality of discussion turned into an ingrown toenail of monkey-discussion[0], then the most probable conclusion is: HN has turned into this echo-chamber (which seems quite inevitable), except it just so happens to be the kind of echoes I agree with. Which is probably worse than an echo-chamber you disagree with.
Hey, good luck. This community building is hard stuff.
Also watch out for the lure of power and control, it's also "hard stuff", of a different kind.
[0] your new rules are already making me doubt whether this is "gratuitous nastiness" or just a funny visual way of expressing a critique. this saddens me. it also makes me feel a couple of other things which I now don't even dare to express any more. that's bad.
If a thread is several days old, not many people will even look at it, so why not just auto-accept those comments?
Give it a whirl. I will certainly read it and can commit to do so daily until the end of April, by which time we'll know if it is working or not. I spend about 50% of my time on the New page already because lots of good stuff passes through there without ever hitting the front page.
If the intent is to keep things racing to the right, simply allow root level comments by everyone and then impose the new pending status to comments on comments. This fixes cperciva's issue and makes it easy to code without having to do timeouts or summary pages.
And thank you for working on this!
There are so many things you've overlooked... This will be an interesting experiment, however I don't think it's a good approach and this decision will likely be reversed.
What would help HN is a system for qualitative feedback to posters who make poor posts. Currently, users notice they are slow or hell banned, have no idea why, and register another account. Why not provide warnings with one or a few preweitten reasons? How about holding banners accountable for their bans, as some seem to ban contrarian viewpoints?
Anyway, good luck with this system. I'm unlikely to spend time writing a comment that may not be seen. I already care less about what I'm writing here, because I discount the chance that it may never go live.
Is the lock on new comments not per-thread?
I'm not sure how well that would work, with the number of comments coming in per second it would be easy for some useful comments to get lost into oblivion.
How about allowing unapproved comments, even older ones, to be deleted by the submitter? That seems a simple and fair solution. Users can unclog their own queues if need be.
But then, what if you make one comment that doesn't make the cut? Again, you never have a chance to comment again.
For threads that have fallen off the frontpage, drop the required number of endorsements to 1 and let the parent commenter have the option to endorse the child comment regardless of the parent poster's karma. That will let back-and-forth continue in old threads.
Please, please do make this. I have exchanged very useful information with other commenters on HN this way.
Sometimes I ask a question in the comments, and it gets answered days later. I go through "comments" in my profile periodically to see if someone replied to those. In this process I also see if someone asked my something and reply there as well.
IMHO, HN should have a "private message" feature if comments get policed this hard.
21 replies →
Or it will allow people to silence those with a differing opinion that the OP doesn't agree with...
Also, so much for 1-on-1 comment threads that are deeply buried and are not intended to be prominently displayed to anyone else. I've had lots of interesting conversations like that.
As I understand it, that's kind of the point.
To kill conversations which are deemed useful by all participants and have no negative impact other than the negligible cost of hosting them?
13 replies →
I think there's a difference between a constructive conversation and a flame war.
If the worry is that comment threads are too long, HN could implement something like reddit, where you click to read additional comments in a long thread.
If purging (substantial and interesting) one-to-one conversation is an intended effect I think that'd be a shame.
2 replies →
Adding a "private message" feature could solve this for all the people who don't want to give a public e-mail in their profile.
1 reply →
There's a huge difference between doing that on the front page and doing that on an article that's already 3 days old.
Related to this, I imagine there are readers such as myself who tend not to engage in conversations so much as offer specialist information on sometimes obscure technical matters. Subjects that even high karma members aren't particularly qualified to have an opinion on.
For example I recently gave a short comment on the PonoPlayer submission that never made it to the front page. For the rare soul that read that submission I indicated the electronics details that indicated how it was distinguished from your usual consumer electronics. That information would be lost from what I see here.
From my own experience, I often won't offer comments unless it seems to me that a contradiction to an existing comment or stream of comments is required, if I feel there is an error. While this system would require best argumentative practice in comments, for clarity and to avoid bias traps and so on, I do hope it doesn't lead to an excess self referentiality.
Even absent the problem with with older threads, there has to be a timeout, otherwise one iffy comment risks putting you into mute forever. That is, IMO, ridiculously punitive especially in light of the warning that you should not endorse if unsure, etc.
And keep in mind that an 'iffy' comment may not even be a bad one. It is pretty common on HN for more than one person to make the same basic point as someone else in a reply to a post (because they both started posting around the same time and didn't see the other replies before making their own) but due to either timing and/or karma boost pulling one person to the top, the rest are basically ignored for upvoting -- I can't imagine that situation would be any different for endorsing. Who wants to endorse a post that says the same thing as another post which is already endorsed (but just happened to be posted 30 seconds later, or by someone with less of a karma boost?).
Perhaps add the ability for a poster to retract his orher pending comments? You could add a mandatory waiting period to prevent abuse.
That's what the delete link does.
This may be a stupid question but exactly where is the delete link? I see deleted comments, but I don't see a delete link or even a downvote button when comments are downvoted. Is there a karma threshold for these?
3 replies →
In which case, a "time out" is redundant if the goal is to simply avoid locking users out.
This system seems to skew discussion toward already popular / active topics, though, since there is less risk of being stuck pending there. Perhaps allowing for multiple pending comments per user (with a limit based on karma, or length of time on the site) would make it less "risky" to post comments in unpopular discussions.
The edit and delete links vanish not long after a post is made. I've never bothered to research the exact duration, but I believe it's no more than 24 hours.
Edit: After some observation, it appears to be two hours. I don't want to be pissy about this, but this is what I was worried about in my other comment--you seem to be making this drastic change with no little thought to how it will interact with the systems and behaviors already in place.
The limit on 1 pending comment per user could be changed to 1 pending comment per user per top-level story. Although I don't see why limit them at all.
So, now that pg has killed HN, where do you guys suggest we gather ?
A new subreddit /r/UntouchablesOfHN?