none
create hbase table from csv RRS feed

  • Question

  • I am trying to create a table in hbase. I created the table with following commands in the hbase shell

    create 'movies', 'num', 'user_rating'

    Then I uploaded my csv into the container with the address 

    wasb://default@teammint.blob.core.windows.net/

    I used the following command to to upload the csv into hbase with no success 

    hbase org.apache.hadoop.hbase.mapreduce.ImportTsv \
    -Dimporttsv.separator=”,”  \
    -Dimporttsv.columns="HBASE_ROW_KEY,num:anime_id, user_rating:rating" movies wasb://  default@teammint.blob.core.windows.net/movie_ratings.csv

    I get a long error log with portions that look like this

    2017-05-14 11:45:44,671 INFO  [main] mapreduce.Job: Task Id : attempt_1494752472954_0008_m_000006_0, Status : FAILED
    Error: java.io.FileNotFoundException: wasb://svotest-2017-05-14t08-55-18-675z@teammochawest2.blob.core.windows.net/atshistory is a directory not a file.
    at org.apache.hadoop.fs.azure.NativeAzureFileSystem.open(NativeAzureFileSystem.java:2447)
    at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:782)
    at org.apache.hadoop.mapreduce.lib.input.LineRecordReader.initialize(LineRecordReader.java:85)
    at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:548)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:786)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
    at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:422)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
    at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)

    It appears that the hbase is looking into the default container of my cluster

    wasb://svotest-2017-05-14t08-55-18-675z@teammochawest2.blob.core.windows.net

    not the path in my command. I tired by puttin my file in the default container, but still got the same error.

    Sunday, May 14, 2017 11:53 AM

Answers