screeley.com

CubbyScott.com | An experiment in 140 character requirements

May8

Is there a 3rd party twitter app that builds a link page based on my follows? If not, someone should build it. It would be my start page.

Fred Wilson posted this tweet a few days ago, a pretty simple requirement. Get all users that Fred is following, parse, get the links and display them for Fred's viewing pleasure. Personally I really like this idea. The problem with an asymmetrical relationship is that you really only follow that person for the interesting links they post. I follow mostly tech people and honestly, their personal comments don't really do much for me. It would be great if I could get all those links into one feed and filter out all the noise.

So in the last 4 days I put together an application to do this. Personal web developer to Fred Wilson and hopefully a few others out there.

First off a few requirements that I added * I'd rather not make the user authenticate, but it turns out that's not such a good idea. Say you are Fred Wilson and you follow 370 people. This means I have to make 370 calls to the twitter apis to get all your friends feeds, a problem when I'm rate limited to 100 an hour. This means you need to authenticate so I can use the friends timeline method. I don't want your password and you don't want to give it to me. Hence we used OAuth. * Get the real link and title of the page, not just the shortened url. * Group by urls to get rid of RTs. * Atom Feeds. I hate leaving Google Reader if I don't have to.

The main issue I have with sites like this is privacy. http://tweetlnks.com/ does sort of the same thing, but look at them. I don't want to give my password to you, ever. This is the reason why I went with OAuth. The other thing is that if your friend's tweets are protected I don't save them. They may be the most interesting person in the world, but if I can't display them in an open feed, they are no good to anyone.

Try it out at http://www.cubbyscott.com/. After you login take note of your Atom feed, because after you authenticate you may never have to come back to the site again. Twitter says that your access token is good forever, so once every 5 minutes or so we grab it and parse your feed again. I'm really hoping that no one that has 300,000 friends logs in because I'll need a fail whale. Please note that Cubby Scott is definitely very Alpha and if it breaks I blame you.

The last interesting part of this app is that a Cubby Scott user's link feed isn't protected in anyway. I'd be interested in looking at a link feed from @biz, @fredwilson or @parislemon and see what they are reading. Privacy issue? You tell me.

The site is built using Django and it's being served off a Linode instance. I'd like to Open Source the OAuth code at some point, but for now it's just a mess. There is a fair amount of caching that is happening in the backend as well. Not ideal for a real time system, but it's being powered by gerbils at this point.

Feedback is welcome. I'm not a designer so, "Your site looks like crap" won't help me much.

And if your interested Cubby Scott is named after a road in Peterborough NH

Comments

Great idea, seems like it would be perfect for a bayesian filtering system on the tweet message. I'd be very interested in seeing the Django OAuth code, no matter what state it is in. Good luck!

I agree! It's good to use django to do anything.

Post Your Comment

I'm a developer out of Boston MA and I work for a consulting firm specializing in open source technologies.

This space will deal with the work I've participated in using the Django framework to build applications for enterprise clients.

Finally, I hate the word blog and Drupal.

Ruminations

  • "А интересно, сам автор читает комментарии к этому сообщению. Или мы тут сами для себя пишем? :)"
    at 4:58a.m. March 9, 2010 | permalink

  • "Прошу прощения за оффтопик. Вы продаете сквозные ссылки с сайта? Если да, свяжитесь со мной, плз!"
    at 8:06p.m. March 8, 2010 | permalink

  • "Об этом уже писал кто-то из моих ЖЖ-френдов :("
    at 10:29a.m. March 8, 2010 | permalink

  • "У Вас долго загружается блог - видимо, хостинг плоховат"
    at 9:41p.m. March 6, 2010 | permalink

  • "I just discovered <a href=http://bit.ly/bMGrYw>SatelliteTV</a> on my PC! Ultra cheap at only $50 once off to get the software and an account on the Internet. ..."
    at 5:20p.m. March 4, 2010 | permalink

  • "Логотип мне нравится:)"
    at 8:47a.m. March 4, 2010 | permalink

  • "Девушки из твоих грёз на твоём рабочем столе. 1.Полностью бесплатно 2.100% безопасность вашего ПК 3.Новые девушки каждый день <a href=http://blogs.mail.ru/mail/erorulez/6605707A18ACC7D6.html>смотреть стриптиз бесплатно</a> http://blogs.mail.ru/mail/erorulez/6605707A18ACC7D6.html эгоистка стриптиз ..."
    at 5:08a.m. March 4, 2010 | permalink

  • "uh.. strange .."
    at 11:54p.m. March 3, 2010 | permalink

  • "Hi guys, I know this might be a bit off topic but seeing that a bunch of you own websites, where would the best place ..."
    at 11:12p.m. March 3, 2010 | permalink

  • "Thanks for this, unbelievable our developer has a robots no follow tag on our site, no wonder it wasn't being found by the search engines ..."
    at 7:40a.m. March 2, 2010 | permalink

  • "В Вашей RSS нельзя получать полные тексты записей, что ли?"
    at 9:37p.m. March 1, 2010 | permalink

  • "Hello, We are representing <a href="http://www.keepingmyhair.com/hair-cloning-a-resume">Hair Loss news</a>. We manage plenty of web sites, and we found your website trought the net. We are asking ..."
    at 12:58a.m. Feb. 28, 2010 | permalink