Latest News Through Wikipedia - Wikipedians are the real Citizen Journalists














People have long predicted the demise of traditional news media and the rise of the citizen journalists. Various initiatives have tried to create new media outlets on the Web, Blog, and Twitter powered by creative swarms of hobby journalists - but none of them has been a breakthrough success so far. Well, it turns out that there is such a citizen Web site, venerable old Wikipedia!

In a series of earlier projects we have analyzed collaboration among Wikipedia authors when creating new Wikipedia articles, for example studying how they collaborate as COINs in different cultures (http://www.ickn.org/documents/COINS2010_Nemoto_Gloor.pdf).
In our current project we are creating a map based on Who-works-with-whom-on-Wikipedia (the "W5-map"). We build a semantic network of concepts by constructing a link between two Wikipedia articles if the same author has worked on both articles. This W5-map shows us to what kind of articles the swarm flocks to. By repeating this process for every month in 2010 we are able to see how the W5-map changes over time.

As the whole Wikipedia includes millions of article, drawing a whole map of Wikipedia in one step is too much. Instead we employed a "snowball sampling" method, which allows us to draw a partial map by selecting a start article or editor. For our first experiment, we used the article about "Wikipedia" as the starting point. We collected the top 10 editors based on the number of edits on this article, then we gathered the top 10 articles of each editor. We repeated this steps recursively up to 3 degrees of separation from the start point. Restricting this analysis to a certain period of time (e.g. one month starting Jan. 1 2010), permits us to obtain a temporal W5 map from this start point. Applying this process repeatedly we calculated 11 snapshots of one month from Jan. 2010 to Nov. 2010. Each node corresponds to an article in Wikipedia. We draw an edge between articles A and B if there are at least 2 editors who made edits both on article A and article B.

The pictures below show our results. Each map was drawn by Gephi, and the size of the article title was determined by the undirected PageRank score of the W5 network. The major topics (based on PageRank Score) for each month are shown below. Surprisingly they reflect the major news item of the month:

Jan. 2010: 2010 Haiti earthquake
Feb. 2010: 2010 Winter Olympics
Mar. 2010: 2010 Polish Air Force Tu-154 crash
Apr. 2010: Telephone (song)
May. 2010: Gaza flotilla raid
Jun. 2010: 2010 FIFA World Cup
Jul. 2010: 2010 FIFA World Cup
Aug. 2010: 2010 Israel-Lebanon border clash
Sep. 2010: 2010 Atlantic hurricane season
Oct. 2010: Copiapo mining accident
Nov. 2010: United States diplomatic cables leak

Furthermore, we can also find clusters of articles, representing a group of similar topics (e.g. a cluster on Lady Gaga or on WikiLeaks).

This means that groups of similarly minded Wikipedians tend to aggregate around a set of articles on a topic they are most interested in.


Looking at Nov. 2010, the United States diplomatic cables leak was strongly connected to WikiLeaks and Julian Assange, which makes perfect sense because both of them are part of the WikiLeaks dispute. Bombardment of Yeonpyeong had many edges from the WikiLeaks cluster while there were no edges from the 2010 Asian Games cluster, which means that Wikipedians working on the Bombardment of Yeonpyeong are interested in the diplomatic problem, not in the topics in Asia.

Our preliminary investigation suggests that looking at Wikipedia through the W5 map might be a new way to identify latest news. We find the news of the world even if we start from a neutral article such as the one about "Wikipedia". The swarm of Wikipedians seems to be a perfect group of coolhunters and citizen journalists to report latest news on politics, celebrities, and sports.

Comments

  1. UnknownFebruary 21, 2013 at 4:37 AM

    Really Wikipedia of any thing is good source to learn about any thing. You have provided us good detail about this. Thanks.

    fresh news

    ReplyDelete

Post a Comment

Popular posts from this blog

Predicting Stock Market Indicators Through Twitter “I hope it is not as bad as I fear”

Image
We have been working on trying to predict market indicators for quite some time by analyzing Web Buzz , predicting who will win an Oscar, or how well movies do at the box office . Among other things we have correlated posts about a stock on Yahoo Finance and Motley’s Fool with the actual stock price, predicting the closing price of the stock on the next day based on what people say today on Yahoo Finance, on the Web and Blogs about a stock title. The rising popularity of twitter gives us a new great way of capturing the collective mind up to the last minute. In our current project we analyze the positive and negative mood of the masses on twitter, comparing it with broad stock market indices such as Dow Jones, S&P 500, and NASDAQ. We collected the twitter feeds from one whitelisted IP for six months from March 30, 2009 to Sept 4, 2009, ranging from 5680 to 42820 tweets per day. According to twitter this corresponds to a randomized subsample of about one hundredth of the full volum...
Read more

My life in Alternative Realities - fatherlanders and nerds don’t go well together

Image
We are all living in different alternative realities, people with different personalities see reality from very different perspectives, potentially leading to a lot of friction and misunderstandings. “Nerds” are open to change, they believe in the progress of technology and innovation. “Fatherlanders” abhor change, they like tradition and authority, valuing the fatherland above all, and would like to reestablish the good old times. “Spiritualists” believe into supernatural forces, they are religious, meditate and hope that the forces of nature will heal their ailing. “Treehuggers” believe into sustainability and global warming, they want to save nature by restricting technical progress. I experience  this friction frequently in my daily life. As a computer and technology nerd with spiritualist and treehugger inclinations, my communication with members from other tribes sometimes does not end well.  My interactions with officers of the US Department of Homeland Security and the...
Read more

How Blind Trust in Generative AI Undermines Creative Work

Image
This summer, we experienced firsthand the damage caused by blind faith in the "superhuman" capabilities of generative AI, even among otherwise intelligent individuals. Here's what happened. We submitted a research paper to an academic conference, and after it was accepted, I paid the registration fee, booked flights, and arranged accommodations. A week later, we received an abrupt email from the organizers stating that our paper had been rejected. The reason? Their AI-based plagiarism and ChatGPT-detection tool flagged it as containing both plagiarized content and text generated by ChatGPT. This accusation was entirely unfounded. Our paper presented highly original work by our team, proposing novel AI algorithms to predict animal emotions—a concept never explored before. We detailed the development of an AI model to validate this approach, something completely unique to our research. By its very nature, it was impossible for our work to be plagiarized or generated by Chat...
Read more