Comment by pmelendez

13 years ago

Thanks for the link.

Agreed I don't think it would be an easy task, but I wonder how would perform a "bag of word" approach.

Harder part as I see it would be to categorize the comments on middlebrow dismissal / Not dismissal. It seems like we would be spending more time preparing the data than in the algorithm itself.

3 comments

pmelendez

Reply
disgruntledphd2  13 years ago

Welcome to statistics/data science/machine learning.

The hardest part is always getting the data into usable form. Its not as much fun as fitting models, but its definitely the majority of any role where people pay you to do this kind of stuff.

There's a lot of good research on forums (pm me if you want a bibliography i collected for a previous role), and short texts have become a bigger deal post Twitter. I completely agree with pg on the somewhat annoying nature of comments such as the GP.

  • pmelendez  13 years ago

    Hey... Thanks for the offer! How can I contact you? I didn't know we can pm users over here.

    I did have worked with ML before but mostly with images which are (IMHO) way easier to put in a format depending on the problem.