Stern Center for Research Computing

Announcements

• Hadoop 1.0.3 installed, including hive 0.7 and the latest mahout and hbase 24 Sep 2012

  The Stern Center for Research Computing  has recently upgraded  hadoop and all of it’s related tools to the latest releases. These include hadoop, hive, pig, hbase, mahout and pegasus. These tools form the basis for the Stern “big data” infrastructure, which can be used to handle very large  or complex data sets that are not amenable to more traditional data storage and analysis techniques.  There are several pilot projects already underway and we are looking for more.  Soon we expect to have  a Sas-Hive link, so that sas users can store their data in hive and use HQL to manipulate [...]

• Links for SAS users 5 Dec 2011

  UCLA SAS materials https://www.ats.ucla.edu/stat/SAS/sk/default.htm Is a complete intro and overview to SAS. It has examples, videos, data sets etc. A good way to both get started with SAS, as well as find advanced techniques.

• Running hadoop, hive and mahout at the Stern Center for Research Computing 19 Jun 2011

  First, you must have your Stern userid enabled for hadoop, and a hadoop user  created for your userid. To do that, please send an email to research@stern.nyu.edu, or call the help desk at 212-998-0180 and create a ticket for research computing. You should be able to run hadoop map-reduce jobs, hive and mahout. To start, type hadoop fs -lsr  / and you should get a list of all the files in the file system. hive will enter the hive command line environment mahout will give you access to the mahout command line. Good luck….