D has been furiously, and I say furiously because this stuff can be frustrating as heck, working on the cohort tables. We think we know how these will be formatted but are constrained by CPU power and time to process them in their final format so we are looking at different ways to compress all the data into a model that we can load into around 1GB of RAM come crunch time.
Like some others we are now using a suite of tools for all sorts of tasks, the main one being MySQL. So far we are using C# to do some analysis, Perl for data transforming and user-user testing on smaller subsets.
Hooyaaa Data.....
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment