Big Data Lab
The Big Data lab at Ben-Gurion University of the Negev conducts research in the area of data science. The lab is also devoted to fostering knowledge for both graduate and undergraduate students. The lab is closely affiliated with the Machine Learning Lab and the Cyber Security Lab.
The Big Data Lab at BGU was established in 2013 by the department of Information Systems Engineering with the generous support of Intel. It is focused on the analysis of very large datasets, especially those that arise in the application areas of web mining and cyber security. The emphasis is on developing novel, sound and theoretically-motivated algorithms for accomplishing large-scale tasks in data mining, such as high-dimensional clustering, classification algorithms and anomaly detection.
The Big Data Lab at BGU employs two Hadoop Clusters. The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. The largest cluster comprised of seven HP servers with a total capacity of over 200TB of disk space, over 350GB of RAM and 144 CPU cores (based on Intel Xeon E5-2630). As such it is considered to be one of the largest Hadoop cluster operating in Israeli academy on physical machines.
Both clusters are using Intel's Distribution for Hadoop which ensures the best performance on Intel processors. In addition the lab is equipped with the latest versions of the Hadoop ecosystem tools such as Spark and Mahout.
Faculty Members
Prof. Lior Rokach
Prof. Bracha Shapira
Dr. Rami Puzis
Lab manager/engineer:
Mandy Hanner
Guy Rappaport
