Welcome 微信登录
编程资源 图片资源库 蚂蚁家优选 PDF转换器

首页 / 操作系统 / Linux / Hadoop 用命令行编译URLCat

Hadoop 用命令行编译URLCatimport java.io.IOException;
import java.io.InputStream;
import java.net.MalformedURLException;
import java.net.URL;import org.apache.hadoop.fs.FsUrlStreamHandlerFactory;
import org.apache.hadoop.io.IOUtils;
public class URLCat {
 static{
  URL.setURLStreamHandlerFactory(new FsUrlStreamHandlerFactory());
 }
 public static void main(String args[]) throws Exception{
  InputStream in = null;
  try{
  in = new URL(args[0]).openStream();
  IOUtils.copyBytes(in, System.out, 4096, false);
  }finally{
   IOUtils.closeStream(in);
  }
 }
}编译javac -classpath hadoop-core-1.1.2.jar -d secondProject secondProject/URLCat.java生成JARjar -cvf URLCat.jar -C secondProject/ . hadoop jar URLCat.jar URLCat hdfs://localhost:49000/user/hadoop/input/file01路径根据 <property>
  <name>fs.default.name</name>
  <value>hdfs://localhost:49000</value>
 </property>调整更多Hadoop相关信息见Hadoop 专题页面 http://www.linuxidc.com/topicnews.aspx?tid=13