Big Data - Semester Plan

ZiBaT => Peter Levinsky => elec-BigData => Information

Module Plan
Elective: Big Data Workshop

Updated : 2017-01-28

Preliminary plan for 'Big Data Workshop' 4 semester elective spring 2017

Objectives for the course
Informations of the course
Literature for the course:
- [Fronter] fronter.com\easj

Additional/Extra Reading
- Fronter: Big Data Forensics – Learning Hadoop Investigations, Joe Sremack, Packt publishing
- http://hortonworks.com/training/

WeekNo Date	Subject/issue	Literature/reading	Exercises
Week 05 30/1	Intro course + subject Intro Hadoop + Hive	https://hadoop.apache.org/ https://wiki.apache.org/hadoop/ slides ( pdf \| pptx )	Installing Hadoop Lab Loading Sensor Data into HDFS Lab Data Manipulation with Hive (Ambari User Views)
Week 06 06/2	Hadoop - more internals and Architecture Map reduce + Pig	Fronter: Big Data Forensics chap 1+2 Fronter: Hadoop Explained https://cwiki.apache.org/confluence/display/PIG/Index Slides ( pdf \| pptx )	Tutorials of analysing (Pig)
Week 07 13/2	*No Classes*
Week 08 20/2	Spark - another analyzing tool	http://spark.apache.org/ Background - read light https://people.csail.mit.edu/matei/papers/2010/hotcloud_spark.pdf http://research.ijcaonline.org/volume113/number1/pxc3900531.pdf	Spark tutorial: http://hortonworks.com/hadoop-tutorial/intro-machine-learning-apache-spark-apache-zeppelin/ Some extra exercises
Week 09 27/2	Analyzing Social Media and Customer Sentiment	Background for Tutorial: some tools Nifi: https://hortonworks.com/apache/nifi/ SolR: https://cwiki.apache.org/confluence/display/solr/Running+Solr+on+HDFS Zeppelin : http://zeppelin-project.org/	http://hortonworks.com/hadoop-tutorial/how-to-refine-and-visualize-sentiment-data/
Week 10 06/3	Analyzing Social Media and Customer Sentiment cont.		http://hortonworks.com/hadoop-tutorial/how-to-refine-and-visualize-sentiment-data/
Week 11 13/3	*No Classes*
Week 12 20/3	Thursday class are moved to Monday the 27^th I have to participate in a meeting thiusday		Mandatory assignment (working in smaller groups 1-2 persons)
Week 13 27/3	Working with a real case classes both monday and thursday	Thursday: A small crash course of validate correlations slides : correlation ( pdf \| pptx )
Week 14 03/4	*Talk: Get ready to meet the requirements for the employee of the future* Working with a real case	Wednesday -- Talk about : How To Be An Employee In the future - for ALL Hints for spark: read in hive to Spark: https://cwiki.apache.org/confluence/display/Hive/Hive+on+Spark%3A+Getting+Started correlation in Spark https://spark.apache.org/docs/latest/mllib-statistics.html (scala) http://blog.sequenceiq.com/blog/2014/09/29/spark-correlation-and-testing/
Week 15 10/4	Easter	Easter	Easter
Week 16 17/4 *)	Working with a real case
Week 17 24/4	Working with a real case		Presentation of Mandatory assignment
Week 18 01/5	Individual study - Synopsis	Individual study - Synopsis Booking supervision see : https://docs.google.com/spreadsheets/d/1KV9HzL9x-Yoz8FoEZYDvewZPu6UBif3jo1eBg4sa_Ik/edit#gid=0	Individual study - Synopsis
Week 19 08/5 **)	Individual study - Synopsis	Individual study - Synopsis	Individual study - Synopsis
Week 20 15/5	Individual study - Synopsis	Individual study - Synopsis	Individual study - Synopsis
Week 21 22/5 ***)	Individual study - Synopsis	Individual study - Synopsis	Individual study - Synopsis *Examples of previous synopsises* ... comming
Week 22 29/5	Individual study - Synopsis	Individual study - Synopsis	Hand in Synopsis friday the 2^nd June before 11:00 AM
Week 23-25 05/5-19/6 ****)	Exam: Preliminary 8-9/June

*) Monday free -- 2nd Easterday
**) Friday free -- kind of all saints day (dk-"store bededag")
***) Thursday and Friday free -- Ascension Day (dk- "kr. himmelfartsdag")
****) Monday free -- White Monday (dk - "Pinsedag")