My first experience with R was in 2007 as a sophomore in undergrad. As part of a larger project on pricing day-ahead electricity futures, I wanted to cluster locational marginal price (LMP) data from the ISO-NE. Something like k-means is easy to plot and visualize in low-dimensions, but this data was better approached by hierarchical methods.
You may have heard about the recently leaked presentation on combating Wikileaks that was produced by employees of HBGary Federal, Palantir Tech, and Berico Tech. You may have also heard that Anonymous retaliated against HB Gary Federal for threatening to release their identities. I thought it would be interesting to run some analysis of the email networks
Just got back from a few days of business in New York. Here's a picture of the the view on approach to LGA on Wednesday afternoon. I never check bags, which means I never bring my Canon EOS, but these stunning opportunities always make me wish I had a real camera.
Here's an OCR'd version of the list of Borders stores that are closing. Now you can copy-paste that table into Excel. Borders Chapter 11 Exhibit A - List of Store Closures (OCR)
Let's say that you want to take a set of documents and apply a computational linguistic technique. If your method is based on the bag-of-words model, you probably need to pre-process these documents first by segmenting, tokenizing, stripping, stopwording, and stemming each one (phew, that's a lot of -ing's). In the past, I've relied
What do 88,831 tweets about protest and revolution in Iran look like? Following in the success of Egypt's #jan25 tag, protesters have piled onto the #25bahman tag to discuss Iran's own prospects for "revolution" (25 Bahman 1389 is the Hijri date for February 14, 2011). Curious to analyze and compare these movements, I've started collecting
I wondered yesterday whether one of the Algeria/Yemen hashtags would dominate. In order to bring some numbers to the discussion, I grabbed all public tweets on #feb12 and #fev12 through this afternoon. You can see the results below: First off, note that all timestamps are UTC. Second, based on the scale, it's pretty clear that
I've been watching the #feb12 tweets on the movements in Algeria and Yemen. One of the most common types of tweets explains how to avoid the current censorship of Twitter, Facebook, and Google by directly entering IPs. This got me thinking - while it may be fairly easy to memorize and disseminate IPv4 addresses, what
Here's another econophysics paper from H. Eugene Stanley and crew: D. Wang, B. Podobnik, D. Horvatić, H. E. Stanley. Quantifying and Modeling Long-Range Cross-Correlations in Multiple Time Series with Applications to World Stock Indices. In my opinion, the primary contribution of the paper isn't really their method. The "global factor model" seems like the same
Algeria and Yemen seem to be pushing a #feb12 revolution hashtag like Egypt's #jan25 tag. In the Egyptian case, the French abbreviation of January didn't vary from the English, and so we really only saw two varieties of the tag - #jan25 and #25jan. I don't have hard numbers on this yet, but from my
