Nick Crawford | MapReduce

Nick Crawford

Home
Research
Publications
Blog
Consulting

Currently viewing the tag: "MapReduce"

Python: Multiprocessing large files

By Nick On March 29, 2012 · Add Comment · In Blog

I been working with a lot of very large files and it has become increasing obvious that using a single processor core is a major bottleneck to getting my data processed in a timely fashion. A MapReduce style algorithm seemed like the way to go, but I had a hard time finding a useful example. [...]

[Continue Reading...]

Recent Posts
Meta

Archives
Blog
Home