Meeting Notes 2015.04.28

I) Merge code:

Integration with main branch - finished

https://github.com/khgl/squall - latest commit

II) Azure:

• Set up the 1G and 100G tpch dataset as vhd in azure storage

• Wrote scripts to automate the provision of Storm supervisors to scale the cluster

• Script to auto mount dataset to VMs at /data/

• The scripts can be found here: https://wiki.epfl.ch/bigdata2015-hypercubejoins/azure-scripts

III) Plan for next week:

Merge Code:

• Merge hypercube and squalltoast branch together

Local Join  

• Finish local join implementation.

Experiment:

• Migrate Hyracks Preaggregation to the new Component

• Run experiment with TPCH 3, 5, 7 on 100G dataset. Collect the result using get_topology_stats scripts.