User:Dahlert

Personal Information

Attends Lindenwood University in St. Charles, MO and is expected to graduate in May 2013 with a BS in Computer Science and Mathematics (if all goes according to plan).

Summer REU Overview

Darla will be working with Dr. George Corliss as her mentor during the Summer 2012 REU at Marquette University in the GasDay lab. She will be setting up and running a Hadoop cluster and using this cluster to run Map/Reduce on the vast amount of data provided by the GasDay lab. This will allow the lab to gain insight on the accuracy of their daily forecasts.

Summer Outline

Week One:

• Orientation
• Introduction to the GasDay lab
• Install proper programs and get laptop set up to coincide with GasDay lab
• Set up a single node Hadoop cluster on VM
• Run MapReduce on single node through JAVA and Python

Week Two:

• Present current and future work/goals to GasDay lab
• Install and set up the rest of the machines in the cluster
• Make sure all machines are running properly
• Run Map/Reduce on entire cluster
• Data preparation

Week Three:

• Define future research directions with Tom and Samson
• Define current problems needing resolved
• Continuation of Tom and Samson's existing work on cluster
• Start paper (Intro)

Week Four:

• Continue working on improving cluster
• Continue paper (Background Info)

Week Five:

• Continue working on and improving cluster
• Paper-Write about current work (body of paper)

Week Six:

• Continue working on and improving cluster
• Paper-Write about current work (body of paper)

Week Seven:

• Continue working on and improving cluster
• Paper-Write about current work (body of paper)

Week Eight:

• Continue working on and improving cluster
• Paper-Write about current work (body of paper)

Week Nine:

• Finish up main work on cluster
• Paper-Write about findings throughout the past 8 weeks and write conclusion
• Start preparing for final presentation

Week Ten:

• Read over entire paper and make last minute adjustments
• Continue to prepare for final presentation
• Final presentation and project submission

Daily Log

May 29, 2012

• Orientation, paperwork and meeting with our mentors

May 30, 2012

• Introduction into the GasDay lab
• Library Orientation
• Started installing the necessary programs on my personal laptop

May 31, 2012

• Upgraded the Virtual Machine on my personal laptop
• Installed Ubuntu on my Virtual Machine
• Updated all the necessary programs on Ubuntu
• Updated REU Wiki

June 1, 2012

• Created a single-node Hadoop cluster on my personal laptop
• Met with Dr. Corliss

June 4, 2012

• LDC Meeting in GasDay lab
• GasDay camp
• Met with Dr. Corliss
• Ran a JAVA based Map/Reduce on some files
• Ran a Python based Map/Reduce on same files and compared to JAVA
• Updated REU Wiki

June 5, 2012

• Dr. Brown's MATLAB tutorial
• Met with Samson and Tom to get appropriate data
• Set up the first node of the cluster

June 6, 2012

• Checked the first node to make sure everything was working properly
• Set up two more of the machines/nodes for the cluster
• Presented my currect work to the GasDay lab

June 7, 2012

• Set up 2 more nodes in the cluster
• Working lunch with REU students
• Bad Sci-fi night

June 8, 2012

• GasDay camp session 3 (all day)
• Set up 2 more nodes in the cluster

June 11, 2012

• Set up the last 3 nodes in the cluster
• Check all 10 nodes to make sure they were running properly

June 12, 2012

• Worked on System Administrator log
• Good Technical Paper/Talk presentation
• Meeting with Dr. Corliss
• Given an 11th machine to add to cluster

June 13, 2012

• Broke everything possible
• Cluster was moved to Dr. Corliss's new office

June 14, 2012

• Added final node to cluster
• Reviewed code with Tom
• Played around with code to get more familiar with Python
• Working lunch with REU students
• Meeting with Dr. Corliss

June 15, 2012

• Continued coding in Python to get more familiar with it
• Development Team's presentation
• Meeting with Dr. Corliss
• Updated REU Wiki
• Reconfigured IP addresses on all machines

June 18, 2012

• LDC meeting
• Read multiple articles
• Meeting with Dr. Corliss
• Meeting with Tom

June 19, 2012

• Python coding
• Read Hadoop information/background
• Meeting with Tom
• Prepared presentation

June 20, 2012

• LaTeX introduction by Dr. Corliss
• Meeting with Dr. Corliss
• Presentation to GasDay lab

June 21, 2012

• Python coding (lots)
• Working lunch with REU students

June 22, 2012

• Coding, coding and more coding

June 25, 2012

• Prepared presentation
• working on a rough outline for my paper
• Met with Dr. Corliss

June 26, 2012

• REU Mini-Presentations

June 27, 2012

• Met with Dr. Corliss
• Started writing paper
• Read a few articles

June 28, 2012

• Met with Dr. Corliss
• Continued working on paper
• Read about version control
• Worked on Python code

June 29, 2012

• Worked on Python code
• Met with Tom
• Met with Dr. Corliss
• Updated Wiki

July 2, 2012

• Worked on paper
• Attempted to put together the multi-node cluster, but was unsuccessful
• Met with Dr. Corliss

July 3, 2012

• Good poster talk with REU students
• Worked out Python code

July 4, 2012

• Holiday!

July 5, 2012

• Continued working on paper
• Had Dr. Corliss read my current draft

July 6, 2012

• Coding is my favorite thing in the whole world

July 9, 2012

• Went through all of my code and made sure it was properly commented
• Coding
• Met with Dr. Corliss
• Worked on paper

July 10, 2012

• Worked on paper

July 11, 2012

• Checked code vs. bad data (It was bad data and not my code. Yay!)
• Met with Dr. Corliss
• GasDay seminars by others
• Worked on my paper

July 12, 2012

• Worked on ideas for GasDay Wiki
• Working lunch with REU students
• Met with Dr. Corliss
• Worked on paper
• Started multi-node cluster with Samson

July 13, 2012

• Met with Dr. Corliss
• Worked on paper
• Ideas for poster
• Read about parallel processing

July 16, 2012

• Worked on multi-node cluster all day
• Started poster

July 17, 2012

• Worked on poster
• Worked on paper
• Multi-node cluster up and running (Yayy!)

July 18, 2012

• Worked on paper
• Unsuccessful attempt to run my programs over cluster
• GasDay seminars
• Continued working on ideas for GasDay Wiki

July 19, 2012

• Worked on paper
• Working lunch with REU students
• Worked on poster (very close to being finished)

July 20, 2012

• Took the day off to visit family

July 23, 2012

• Met with Tom to work on cluster
• Worked on paper
• Worked on abstract
• Ran my programs over most of the data

July 24, 2012

• Worked on code
• Worked on abstract
• Re-ran code over the data (twice)
• Graphed results
• Worked on poster
• Worked on presentation for GasDay (7/25)

July 25, 2012

• GasDay seminar presentation
• Worked on paper
• Finished poster
• Finished abstract
• Met with Dr. Corliss
• Worked on final presentation
• Organized files for GasDay Wiki

July 26, 2012

• Worked on paper
• Met with Dr. Corliss

July 27, 2012

• Met with Dr. Corliss
• Worked on paper
• Worked on GasDay Wiki
• Updated REU Wiki

July 30, 2012

• Worked on paper
• Met with Dr. Corliss

July 31, 2012

• Worked on paper
• Worked on GasDay Wiki
• Poster session with REU students

August 1, 2012

• Worked on paper and wiki
• Met with Dr. Corliss
• Finished final presentation
• Updated REU Wiki

August 2, 2012

• Final presentations with REU students
• Finishing touches to paper and Wiki
• Bad Sci-Fi night
• Celebration!