Digging into Twitter following
This is just a quick post. I have a ton of things I could say about this, but they’ll have to wait – I need to do some real work.
Last night and today I wrote some Python code to dig into the follower and following sets of Twitter users.
I also think I understand better why Twitter is so compelling, but that’s going to have to wait for now too.
You give my program some Twitter user names and it builds you a table showing numbers of followers, following etc. for each user. It distinguishes between people you follow and who don’t follow you, and people who follow you but whom you don’t follow back.
But the really interesting thing is to look at the intersection of some of these sets between users.
For example, if I follow X and they don’t follow me back, we can assume I have some interest in X. So if am later followed by Y and it turns out that X follows Y, I might be interested to know that. I might want to follow Y back just because I know it might bring me to the attention of X, who may then follow me. If I follow Y, I might want to publicly @ message him/her, hoping that he/she might @ message me back, and that X may see it and follow me.
Stuff like that. If you think that sort of thing isn’t important, or is too detailed or introspective, I’ll warrant you don’t know much about primate social studies. But more on that in another posting too.
As another example use, I plan to forward the mails Twitter sends me telling me someone new is following me into a variant of my program. It can examine the sets of interest and weight them. That can give me an automated recommendation of whether I should follow that person back – or just do the following for me.
There are lots of directions you could push this in, like considering who the person had @ talked to (and whether those people were followers or not) and the content of their Tweets (e.g., do they talk about things I’m interested or not interested in?).
Lots.
For now, here are links to a few sample runs. Apologies to the Twitter users I’ve picked on – you guys were on my screen or on my mind (following FOWA).
I’d love to turn these into nice Euler Diagrams but I didn’t find any decent open source package to produce them.
I’m also hoping someone else (or other people) will pick this up and run with it. I’ve got no time for it! I’m happy to send the source code to anyone who wants it. Just follow me on Twitter and ask for it.
Example 1: littleidea compared to sarawinge.
Example 2: swardley compared to voidspace.
Example 3: aweissman compared to johnborthwick.
And finally here’s the result for deWitt, on whose Twitter Python library I based my own code. This is the output you get from the program when you only give it one user to examine.
More soon, I guess.
You can follow any responses to this entry through the RSS 2.0 feed. Both comments and pings are currently closed.
October 14th, 2008 at 5:27 pm
You can use graphviz to generate Euler diagrams (as long as you are picking what intersections you do/don’t want to show) by using nested nodes.
October 14th, 2008 at 7:27 pm
You can use graphviz to generate Euler diagrams (as long as you are picking what intersections you do/don’t want to show) by using nested nodes.
October 14th, 2008 at 5:29 pm
Oh, and you may be able to generate some interesting connection diagrams pretty easily with either graphviz or aiSee.
October 14th, 2008 at 7:29 pm
Oh, and you may be able to generate some interesting connection diagrams pretty easily with either graphviz or aiSee.
October 17th, 2008 at 8:06 am
Hi Dan
Thanks. Sorry for the slow reply. I’ve used fdp (one of the GraphViz suite) in the past. But I don’t see how to use any of the programs to make a Euler diagram. Am I missing something obvious? There’s a layout optimization problem, which I suppose GraphViz could help with, but there’s also the fact that I want to draw shapes with lots of points in them, with intersections, and that doesn’t seem to lend itself to a graph-drawing approach. But maybe I’m wrong?
Thanks again,
Terry
October 17th, 2008 at 10:06 am
Hi Dan
Thanks. Sorry for the slow reply. I’ve used fdp (one of the GraphViz suite) in the past. But I don’t see how to use any of the programs to make a Euler diagram. Am I missing something obvious? There’s a layout optimization problem, which I suppose GraphViz could help with, but there’s also the fact that I want to draw shapes with lots of points in them, with intersections, and that doesn’t seem to lend itself to a graph-drawing approach. But maybe I’m wrong?
Thanks again,
Terry
December 11th, 2008 at 10:23 am
Hey, i have just release a python research tool a few weeks ago that let’s you crawl Twitter following, followers and favorites (and other things like Facebook friends) and visualize the graphs with graphviz:
http://corelabs.coresecurity.com/index.php?module=FrontEndMod&action=view&type=tool&name=Exomind
hope you find it useful!
jose.
December 11th, 2008 at 11:23 am
Hey, i have just release a python research tool a few weeks ago that let’s you crawl Twitter following, followers and favorites (and other things like Facebook friends) and visualize the graphs with graphviz:
http://corelabs.coresecurity.com/index.php?module=FrontEndMod&action=view&type=tool&name=Exomind
hope you find it useful!
jose.
December 11th, 2008 at 12:37 pm
Hi Jose
Sounds great! I’ll try to give it a go next week. I’m stuck in an airport, not enjoying myself :-(
Terry
December 11th, 2008 at 1:37 pm
Hi Jose
Sounds great! I’ll try to give it a go next week. I’m stuck in an airport, not enjoying myself :-(
Terry