显示标签为“Hbase”的博文。显示所有博文
显示标签为“Hbase”的博文。显示所有博文

2013年7月27日星期六

HBase Shell 's SPLIT

About HBase I look at the HBase Shell
 create 't1', 'f1', {SPLITS => ['01 ', '02', '03 ', ; '04 ']}  
on the above sentence in SPLITS Please pass heroes gets advice
Shell seem to introduce this evening only to find a few this , but did not explain
------ Solution - ------------------------------------------
?This post last edited by the tntzbzc on 2013-06-07 00:24:31 ah , the official website of courage vague explanation
SPLITS role is to create a table , it will default to the table of the N Region
examples according to the official website [ '01 ', '02 ', '03 ', '04' ] , table t1 will be created when the sub- 5 region, RowKEY by lexicographical partition
Rowkey less than " 01" , assigned to the region1
Rowkey greater than equal to " 01" is less than "02" , assigned to the region2
Rowkey greater than equal to " 02" is less than "03" , assigned region3
Rowkey greater than equal to " 03 " is less than "04" , assigned region4
Rowkey greater than equal to " 04" , assigned region5

Assuming execute the following command
put 't1', '00101 ',' f1: c1 ',' hello '
put 't1', '00201 ',' f1: c1 ',' hello '
put 't1', '01101 ',' f1: c1 ',' hello '
put 't1', '02101 ',' f1: c1 ',' hello '
put 't1', '02201 ',' f1: c1 ',' hello '
put 't1', '03101 ',' f1: c1 ',' hello '
put 't1', '03201 ',' f1: c1 ',' hello '
put 't1', '04101 ',' f1: c1 ',' hello '
00101 and 00201 will be assigned region1, because lexicographical 00 101 and 00 201 's left (2) is less than " 01 ", pay attention to see bold , and so on
01101 assigned region2
02101 and 02201 assigned region3
03101 and 03201 assigned region4
04101 assigned region5

Hbase and wordcount errors

?This post last edited by the sen_lin8350 on 2013-06-02 15:36:56
errors are as follows:
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: zookeeper.version = 3.3.2-1031432, built on 11/05/2010 05:32 GMT
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: host.name = ubuntu
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: java.version = 1.6.0_27
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: java.vendor = Sun Microsystems Inc.
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: java.home = / usr/lib/jvm/java-6-openjdk-i386/jre
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: java.class.path = / home / hp / workspace / WordCountHBase.java / bin :/ home / hp/hadoop-0.20.203.0/lib/slf4j-api-1.4.3.jar :/ home/hp/hadoop-0.20.203.0/lib/commons-logging-api-1.0.4.jar :/ home / hp / hadoop-0.20.203.0/lib/xmlenc-0.52.jar :/ home/hp/hadoop-0.20.203.0/lib/mockito-all-1.8.0.jar :/ home/hp/hadoop-0.20.203.0/lib / commons-cli-1.2.jar :/ home/hp/hadoop-0.20.203.0/lib/hsqldb-1.8.0.10.jar :/ home/hp/hadoop-0.20.203.0/lib/jasper-runtime-5.5.12. jar :/ home/hp/hadoop-0.20.203.0/lib/jetty-6.1.14.jar :/ home/hp/hadoop-0.20.203.0/lib/junit-3.8.1.jar :/ home / hp / hadoop -0.20.203.0/lib/servlet-api-2.5-6.1.14.jar :/ home/hp/hadoop-0.20.203.0/lib/commons-httpclient-3.0.1.jar :/ home/hp/hadoop-0.20 .203.0/lib/commons-el-1.0.jar :/ home/hp/hadoop-0.20.203.0/lib/jets3t-0.6.1.jar :/ home/hp/hadoop-0.20.203.0/lib/commons-logging -1.0.4.jar :/ home/hp/hadoop-0.20.203.0/lib/commons-net-1.4.1.jar :/ home/hp/hadoop-0.20.203.0/lib/commons-codec-1.3.jar :/ home/hp/hadoop-0.20.203.0/lib/core-3.1.1.jar :/ home/hp/hadoop-0.20.203.0/lib/oro-2.0.8.jar :/ home/hp/hadoop- 0.20.203.0/lib/log4j-1.2.15.jar :/ home/hp/hadoop-0.20.203.0/lib/jasper-compiler-5.5.12.jar :/ home/hp/hadoop-0.20.203.0/lib / kfs-0.2.2.jar :/ home/hp/hadoop-0.20.203.0/lib/slf4j-log4j12-1.4.3.jar :/ home/hp/hadoop-0.20.203.0/lib/jetty-util-6.1. 14.jar :/ home/hp/hadoop-0.20.203.0/hadoop-0.20.2-core.jar :/ home/hp/hadoop-0.20.203.0/hadoop-0.20.2-ant.jar :/ home / hp / hadoop-0.20.203.0/hadoop-0.20.2-tools.jar :/ home/hp/hbasejar/hbase-0.20.0.jar :/ home/hp/hbase-0.90.6/hbase-0.90.6.jar :/ home/hp/hbase-0.90.6/hbase-0.90.6-tests.jar :/ home/hp/hbase-0.90.6/lib/activation-1.1.jar :/ home/hp/hbase-0.90. 6/lib/asm-3.1.jar :/ home/hp/hbase-0.90.6/lib/avro-1.3.3.jar :/ home/hp/hbase-0.90.6/lib/commons-cli-1.2. jar :/ home/hp/hbase-0.90.6/lib/commons-codec-1.4.jar :/ home/hp/hbase-0.90.6/lib/commons-el-1.0.jar :/ home / hp / hbase -0.90.6/lib/commons-httpclient-3.1.jar :/ home/hp/hbase-0.90.6/lib/commons-lang-2.5.jar :/ home/hp/hbase-0.90.6/lib/commons -logging-1.1.1.jar :/ home/hp/hbase-0.90.6/lib/commons-net-1.4.1.jar :/ home/hp/hbase-0.90.6/lib/core-3.1.1 . jar :/ home/hp/hbase-0.90.6/lib/guava-r06.jar :/ home/hp/hbase-0.90.6/lib/hadoop-0.20.2-core.jar :/ home / hp / hbase-0.90.6/lib/jackson-core-asl-1.5.5.jar :/ home/hp/hbase-0.90.6/lib/jackson-jaxrs-1.5.5.jar :/ home/hp/hbase- 0.90.6/lib/jackson-mapper-asl-1.4.2.jar :/ home/hp/hbase-0.90.6/lib/jackson-xc-1.5.5.jar :/ home/hp/hbase-0.90. 6/lib/jasper-compiler-5.5.23.jar :/ home/hp/hbase-0.90.6/lib/jasper-runtime-5.5.23.jar :/ home/hp/hbase-0.90.6/lib / jaxb-api-2.1.jar :/ home/hp/hbase-0.90.6/lib/jaxb-impl-2.1.12.jar :/ home/hp/hbase-0.90.6/lib/jersey-core-1.4. jar :/ home/hp/hbase-0.90.6/lib/jersey-json-1.4.jar :/ home/hp/hbase-0.90.6/lib/jersey-server-1.4.jar :/ home / hp / hbase -0.90.6/lib/jettison-1.1.jar :/ home/hp/hbase-0.90.6/lib/jetty-6.1.26.jar :/ home/hp/hbase-0.90.6/lib/jetty-util -6.1.26.jar :/ home/hp/hbase-0.90.6/lib/jruby-complete-1.6.0.jar :/ home/hp/hbase-0.90.6/lib/jsp-2.1-6.1.14 . jar :/ home/hp/hbase-0.90.6/lib/jsp-api-2.1-6.1.14.jar :/ home/hp/hbase-0.90.6/lib/jsr311-api-1.1.1.jar :/ home/hp/hbase-0.90.6/lib/log4j-1.2.16.jar :/ home/hp/hbase-0.90.6/lib/protobuf-java-2.3.0.jar :/ home / hp / hbase-0.90.6/lib/servlet-api-2.5-6.1.14.jar :/ home/hp/hbase-0.90.6/lib/slf4j-api-1.5.8.jar :/ home/hp/hbase- 0.90.6/lib/slf4j-log4j12-1.5.8.jar :/ home/hp/hbase-0.90.6/lib/stax-api-1.0.1.jar :/ home/hp/hbase-0.90.6 / lib/thrift-0.2.0.jar :/ home/hp/hbase-0.90.6/lib/xmlenc-0.52.jar :/ home/hp/hbase-0.90.6/lib/zookeeper-3.3.2.jar
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: java.library.path = / usr/lib/jvm/java-6-openjdk-i386/jre / lib/i386/client :/ usr/lib/jvm/java-6-openjdk-i386/jre/lib/i386 :/ usr/lib/jvm/java-6-openjdk-i386/jre/../lib / i386 :/ usr/lib/jvm/java-6-openjdk-i386/jre/lib/i386/client :/ usr/lib/jvm/java-6-openjdk-i386/jre/lib/i386 :: / usr / java/packages/lib/i386 :/ usr/lib/i386-linux-gnu/jni :/ lib/i386-linux-gnu :/ usr/lib/i386-linux-gnu :/ usr / lib / jni :/ lib :/ usr / lib
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: java.io.tmpdir = / tmp
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: java.compiler =
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: os.name = Linux
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: os.arch = i386
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: os.version = 3.5.0-23-generic
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: user.name = hp
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: user.home = / home / hp
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Client environment: user.dir = / home / hp / workspace / WordCountHBase.java
13/06/02 15:25:00 INFO zookeeper.ZooKeeper: Initiating client connection, connectString = localhost: 2181 sessionTimeout = 60000 watcher = org.apache.hadoop. hbase.client.HConnectionManager $ TableServers @ 173831b
13/06/02 15:25:00 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1: 2181
13/06/02 15:25:00 INFO zookeeper.ClientCnxn: Socket connection established to localhost/127.0.0.1: 2181, initiating session
13/06/02 15:25:00 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost/127.0.0.1: 2181, sessionid = 0x13f0396f968000b , negotiated timeout = 60000
13/06/02 15:25:00 INFO client.HConnectionManager $ TableServers: getMaster attempt 0 of 10 failed; retrying after sleep of 2000
java.io.IOException: Call to ubuntu/192.168.10.132: 60000 failed on local exception: java.io.EOFException
at org.apache.hadoop.hbase.ipc.HBaseClient.wrapException (HBaseClient.java: 757)
at org.apache.hadoop.hbase.ipc.HBaseClient.call (HBaseClient.java: 727)
at org.apache.hadoop.hbase.ipc.HBaseRPC $ Invoker.invoke (HBaseRPC.java: 328)
at sun.proxy. $ Proxy0.getProtocolVersion (Unknown Source)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy (HBaseRPC.java: 486)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy (HBaseRPC.java: 462)
at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy (HBaseRPC.java: 509)
at org.apache.hadoop.hbase.client.HConnectionManager $ TableServers.getMaster (HConnectionManager.java: 259)
at org.apache.hadoop.hbase.client.HBaseAdmin. (HBaseAdmin.java: 72)
at WordCountHBase.createHBaseTable (WordCountHBase.java: 75)
at WordCountHBase.main (WordCountHBase.java: 28)
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt (DataInputStream.java: 392)
at org.apache.hadoop.hbase.ipc.HBaseClient $ Connection.receiveResponse (HBaseClient.java: 505)
at org.apache.hadoop.hbase.ipc.HBaseClient $ Connection.run (HBaseClient.java: 449)


I use hadoop0.20.203.0 hbase hadoop use habse-0.90.6
hbase configuration is as follows:

hbase.rootdir
hdfs :/ / localhost: 9000/hbase


hbase.cluster.distributed
true


dfs.support.append
true


hbase.zooker.quorum
localhost


------ Solution ------------------------------------ --------
?This post last edited by the tntzbzc on 2013-06-02 19:13:28
Try these methods


1, my visual landlord hadoop and Hbase is deployed on a machine, so we first hadoop and hbase machine's / etc / hosts plus
192.168.10.132 ubuntu
# If you added a look at the following

2, check the / etc / sysconfig / network the hostname is correct (it should be ubuntu)

3, the hadoop and hbase all configurations Localhost replaced all ubuntu
restart hbase and Hadoop, retest

hadoop0.20.205 and Hbase 0.90.X version now rarely used.
I do not have two versions of this test environment, LZ as I said above, the first test again

------ For reference only ---------------------------------- -----
ubuntu/192.168.10.132: 60000
This is the machine?

------ For reference only ---------------------------------- -----
wow, it seems that the problem is not small
------ For reference only ----------------------- ----------------
??The reply deleted by an administrator at 2013-06-02 17:18:00
------ For reference only ---------------------------------- -----
their machines / etc / hosts contents of 192.168.10.132 ubuntu
------ For reference only ------------ ---------------------------
forgot to ask
LZ ZOOKEEPER deployment where you also check
------ For reference only ----------------------- ----------------
Yes, I first check!
------ For reference only -------------------------------------- -
??This reply was moderator deleted at 2013-06-02 23:11:05
------ For reference only ---------------------------------- -----
zookeeper using hbase-0.90.6 own version
------ For reference only ------------------ ---------------------
according to the above method, after Geller, hbase not run!
------ For reference only -------------------------------------- -


This is really old versions egg pain. . . LZ you must use this version now?
take a look at what is wrong and put them out to see it
------ For reference only ---------------------- -----------------
forget or change version of it! Ask The latest stable version is hadoop and hbase how much?

------ For reference only ---------------------------------- -----
hadoop 1.1.2
hbase 0.94.7
------ For reference only ----------------------------- ----------
Thank you, big help!