Monthly Archives: May 2015

Report on Optimizing Spark for Multi-core Systems

This is a class project we did for 6.824 at MIT. We implemented optimizations in using multithreaded tasks in Spark and showed significant memory efficiency improvement for KMeans. We also showed potential speed up for PageRank, currently we were able … Continue reading

Posted in Uncategorized | Leave a comment