You're Going to Need a Bigger Boat...
This is a site for large data sets and the people who love them: the scrapers and crawlers who collect them, the academics and geeks who process them, the designers and artists who visualize them. It’s a place where they can exchange tips and tricks, develop and share tools together, and begin to integrate their particular projects.
This sort of activity was my major R&D project last year & will be a major theme this year.
Something I suspect some of the newly interested players in this space haven’t realized is how time and hardware intense some of this work is… they’re gonna need a bigger boat.
